[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:09:57 dist-test-slave-rmhg krb5kdc[4214](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:09:57 dist-test-slave-rmhg krb5kdc[4214](info): set up 2 sockets
Aug 12 11:09:57 dist-test-slave-rmhg krb5kdc[4214](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260812 11:09:58.940382 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.003s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:09:59 dist-test-slave-rmhg krb5kdc[4214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:09:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:09:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:09:59.139910 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:39275
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:44859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:39275
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:09:59.505679 4241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:09:59.506134 4241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:09:59.506274 4241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:09:59.513787 4241 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:09:59.513914 4241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:09:59.513989 4241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:09:59.514078 4241 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:09:59.514139 4241 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:09:59.525419 4241 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:44859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:39275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:39275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:09:59.527617 4241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:09:59.529747 4241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:09:59.550946 4241 server_base.cc:1034] running on GCE node
W20260812 11:09:59.550823 4248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:59.550815 4253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:09:59.550976 4249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:09:59.554529 4241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:09:59.557230 4241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:09:59.558501 4241 hybrid_clock.cc:648] HybridClock initialized: now 1786532999558423 us; error 67 us; skew 500 ppm
I20260812 11:09:59.559069 4241 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:09:59 dist-test-slave-rmhg krb5kdc[4214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532999, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:09:59.563186 4241 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:09:59.566064 4241 webserver.cc:460] Webserver started at http://127.4.26.126:33097/ using document root <none> and password file <none>
I20260812 11:09:59.567291 4241 fs_manager.cc:359] Metadata directory not provided
I20260812 11:09:59.567428 4241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:09:59.567935 4241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:09:59.572542 4241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "2f682c0d6c944fb1b88afcd29958237f"
format_stamp: "Formatted at 2026-08-12 11:09:59 on dist-test-slave-rmhg"
server_key: "bca4b5b85ee0e3748a1cce473a4afe77"
server_key_iv: "cf701ebeae1bdc4e41cf368b6480b3f4"
server_key_version: "encryptionkey@0"
I20260812 11:09:59.573521 4241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "2f682c0d6c944fb1b88afcd29958237f"
format_stamp: "Formatted at 2026-08-12 11:09:59 on dist-test-slave-rmhg"
server_key: "bca4b5b85ee0e3748a1cce473a4afe77"
server_key_iv: "cf701ebeae1bdc4e41cf368b6480b3f4"
server_key_version: "encryptionkey@0"
I20260812 11:09:59.583107 4241 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.002s sys 0.005s
I20260812 11:09:59.590384 4264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:09:59.592919 4241 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.002s
I20260812 11:09:59.593287 4241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "2f682c0d6c944fb1b88afcd29958237f"
format_stamp: "Formatted at 2026-08-12 11:09:59 on dist-test-slave-rmhg"
server_key: "bca4b5b85ee0e3748a1cce473a4afe77"
server_key_iv: "cf701ebeae1bdc4e41cf368b6480b3f4"
server_key_version: "encryptionkey@0"
I20260812 11:09:59.593523 4241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:09:59.616322 4241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:09:59.622345 4241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:09:59.622712 4241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:09:59.645809 4241 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:39275
I20260812 11:09:59.645839 4353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:39275 every 8 connection(s)
I20260812 11:09:59.648859 4241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:09:59.651957 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 4241
I20260812 11:09:59.652443 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:09:59.655757 4201 external_mini_cluster.cc:1428] Setting key 968e9f9274cac95ea036e46d1060d45d
I20260812 11:09:59.659118 4354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:09:59.680768 4354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f: Bootstrap starting.
I20260812 11:09:59.687659 4354 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f: Neither blocks nor log segments found. Creating new log.
I20260812 11:09:59.689507 4354 log.cc:824] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:09:59.694031 4354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f: No bootstrap required, opened a new log
Aug 12 11:09:59 dist-test-slave-rmhg krb5kdc[4214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786532999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:09:59.705576 4354 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f682c0d6c944fb1b88afcd29958237f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 39275 } }
I20260812 11:09:59.706362 4354 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:09:59.706681 4354 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f682c0d6c944fb1b88afcd29958237f, State: Initialized, Role: FOLLOWER
I20260812 11:09:59.707820 4357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:09:59.666191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43116 (local address 127.4.26.126:39275)
0812 11:09:59.667995 (+ 1804us) server_negotiation.cc:206] Beginning negotiation
0812 11:09:59.668019 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 11:09:59.668105 (+ 86us) server_negotiation.cc:407] Connection header received
0812 11:09:59.677682 (+ 9577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:09:59.677714 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:09:59.678431 (+ 717us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:09:59.678948 (+ 517us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:09:59.682771 (+ 3823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:59.684205 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:59.686080 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:09:59.686849 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:09:59.687135 (+ 286us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:09:59.696583 (+ 9448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:09:59.696659 (+ 76us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:09:59.696708 (+ 49us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:09:59.696755 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:09:59.700369 (+ 3614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:59.701571 (+ 1202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:59.701587 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:59.701597 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:59.701909 (+ 312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:09:59.702608 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:09:59.702643 (+ 35us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:09:59.702645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:09:59.703426 (+ 781us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:09:59.703820 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0812 11:09:59.705500 (+ 1680us) server_negotiation.cc:299] Negotiation successful
0812 11:09:59.705879 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1296,"thread_start_us":938,"threads_started":1}
I20260812 11:09:59.707990 4354 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f682c0d6c944fb1b88afcd29958237f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 39275 } }
I20260812 11:09:59.708475 4354 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:09:59.708847 4354 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:09:59.709188 4354 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:09:59.712255 4354 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f682c0d6c944fb1b88afcd29958237f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 39275 } }
I20260812 11:09:59.713567 4354 leader_election.cc:302] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f682c0d6c944fb1b88afcd29958237f; no voters:
I20260812 11:09:59.714438 4354 leader_election.cc:288] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:09:59.714759 4361 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:09:59.715551 4361 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [term 1 LEADER]: Becoming Leader. State: Replica: 2f682c0d6c944fb1b88afcd29958237f, State: Running, Role: LEADER
I20260812 11:09:59.716337 4361 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f682c0d6c944fb1b88afcd29958237f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 39275 } }
I20260812 11:09:59.717592 4354 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:09:59.721436 4362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f682c0d6c944fb1b88afcd29958237f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f682c0d6c944fb1b88afcd29958237f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 39275 } } }
I20260812 11:09:59.722031 4362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [sys.catalog]: This master's current role is: LEADER
I20260812 11:09:59.721487 4363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f682c0d6c944fb1b88afcd29958237f. Latest consensus state: current_term: 1 leader_uuid: "2f682c0d6c944fb1b88afcd29958237f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f682c0d6c944fb1b88afcd29958237f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 39275 } } }
I20260812 11:09:59.722330 4363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f [sys.catalog]: This master's current role is: LEADER
I20260812 11:09:59.723332 4373 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:09:59.733817 4373 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:09:59.751014 4373 catalog_manager.cc:1347] Generated new cluster ID: 2c58b343d4c7422888ae4e18306481e2
I20260812 11:09:59.751158 4373 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:09:59.780176 4373 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:09:59.782444 4373 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:09:59.800684 4373 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f682c0d6c944fb1b88afcd29958237f: Generated new TSK 0
I20260812 11:09:59.802201 4373 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:09:59.857722 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:39275
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:44859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:00.218266 4396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:00.218771 4396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:00.218950 4396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:00.227605 4396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:00.227741 4396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:00.227907 4396 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:10:00.238538 4396 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:44859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:39275
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:00.239990 4396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:00.241595 4396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:00.257212 4405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:00.257285 4404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:00.257275 4409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:00.258916 4396 server_base.cc:1034] running on GCE node
I20260812 11:10:00.259701 4396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:00.260908 4396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:00.262166 4396 hybrid_clock.cc:648] HybridClock initialized: now 1786533000262098 us; error 60 us; skew 500 ppm
I20260812 11:10:00.262523 4396 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:00 dist-test-slave-rmhg krb5kdc[4214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533000, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:00.266106 4396 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:10:00.267853 4396 webserver.cc:460] Webserver started at http://127.4.26.65:35831/ using document root <none> and password file <none>
I20260812 11:10:00.268648 4396 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:00.268793 4396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:00.269137 4396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:00.272497 4396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "4e5b18254f894229a6fb2b297771c0c6"
format_stamp: "Formatted at 2026-08-12 11:10:00 on dist-test-slave-rmhg"
server_key: "202605a3c37b14314c6290b612f8af14"
server_key_iv: "f07c93c7e695557fab3ee11fa9d00f43"
server_key_version: "encryptionkey@0"
I20260812 11:10:00.273463 4396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "4e5b18254f894229a6fb2b297771c0c6"
format_stamp: "Formatted at 2026-08-12 11:10:00 on dist-test-slave-rmhg"
server_key: "202605a3c37b14314c6290b612f8af14"
server_key_iv: "f07c93c7e695557fab3ee11fa9d00f43"
server_key_version: "encryptionkey@0"
I20260812 11:10:00.279556 4396 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 11:10:00.283771 4419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:00.285429 4396 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:00.285658 4396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "4e5b18254f894229a6fb2b297771c0c6"
format_stamp: "Formatted at 2026-08-12 11:10:00 on dist-test-slave-rmhg"
server_key: "202605a3c37b14314c6290b612f8af14"
server_key_iv: "f07c93c7e695557fab3ee11fa9d00f43"
server_key_version: "encryptionkey@0"
I20260812 11:10:00.285890 4396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:00.311861 4396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:00.316819 4396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:00.317184 4396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:00.318569 4396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:00.320653 4396 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:00.320748 4396 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:00.320955 4396 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:00.321027 4396 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:00.356148 4396 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:42611
I20260812 11:10:00.356207 4605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:42611 every 8 connection(s)
I20260812 11:10:00.357687 4396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:00.360589 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 4396
I20260812 11:10:00.360823 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:00.361784 4201 external_mini_cluster.cc:1428] Setting key 0a0c2f89e9513e1b6648ba9c38d2853e
Aug 12 11:10:00 dist-test-slave-rmhg krb5kdc[4214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533000, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
I20260812 11:10:00.385700 4609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:00.361842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:59987 (local address 127.4.26.126:39275)
0812 11:10:00.362427 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:00.362432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:00.363875 (+ 1443us) server_negotiation.cc:407] Connection header received
0812 11:10:00.366057 (+ 2182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:00.366064 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:00.366153 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:00.366273 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:00.368175 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:00.369335 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:00.371659 (+ 2324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:00.372125 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:00.372260 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:00.377815 (+ 5555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:00.377823 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:00.377828 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:00.377881 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:00.381634 (+ 3753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:00.382928 (+ 1294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:00.382934 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:00.382937 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:00.383098 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:00.383701 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:00.383704 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:00.383706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:00.383993 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:00.384156 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:00.385212 (+ 1056us) server_negotiation.cc:299] Negotiation successful
0812 11:10:00.385426 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":332,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
I20260812 11:10:00.387030 4611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:00.362633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:39275 (local address 127.4.26.65:59987)
0812 11:10:00.363659 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:00.363721 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:00.365701 (+ 1980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:00.366592 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:00.366602 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:00.367260 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:00.367934 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:00.367965 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:00.369589 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:00.369594 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:00.371402 (+ 1808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:00.371426 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:00.372452 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:00.372462 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:00.372825 (+ 363us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:00.373751 (+ 926us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:00.373785 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:00.377398 (+ 3613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:00.381903 (+ 4505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:00.381916 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:00.381942 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:00.382753 (+ 811us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:00.383256 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:00.383262 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:00.383265 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:00.383593 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:00.384146 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:00.384156 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:00.384597 (+ 441us) client_negotiation.cc:769] Sending connection context
0812 11:10:00.385025 (+ 428us) client_negotiation.cc:240] Negotiation successful
0812 11:10:00.385550 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"thread_start_us":386,"threads_started":1}
I20260812 11:10:00.389321 4607 heartbeater.cc:347] Connected to a master server at 127.4.26.126:39275
I20260812 11:10:00.389915 4607 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:00.390960 4607 heartbeater.cc:511] Master 127.4.26.126:39275 requested a full tablet report, sending...
I20260812 11:10:00.395923 4291 ts_manager.cc:194] Registered new tserver with Master: 4e5b18254f894229a6fb2b297771c0c6 (127.4.26.65:42611)
I20260812 11:10:00.398833 4291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:59987
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:10:00.414779 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:39275
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:44859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:00.773435 4615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:00.773769 4615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:00.773881 4615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:00.781917 4615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:00.782078 4615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:00.782203 4615 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:10:00.793030 4615 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:44859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:39275
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:00.794589 4615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:00.796031 4615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:00.811480 4625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:00.811506 4623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:00.811550 4629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:00.812278 4615 server_base.cc:1034] running on GCE node
I20260812 11:10:00.812964 4615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:00.814100 4615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:00.815346 4615 hybrid_clock.cc:648] HybridClock initialized: now 1786533000815295 us; error 47 us; skew 500 ppm
I20260812 11:10:00.815696 4615 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:00 dist-test-slave-rmhg krb5kdc[4214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533000, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:00.819406 4615 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:10:00.821416 4615 webserver.cc:460] Webserver started at http://127.4.26.66:37723/ using document root <none> and password file <none>
I20260812 11:10:00.822255 4615 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:00.822387 4615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:00.822742 4615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:00.826465 4615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "cc2f5b4c94a54fed86715dba7052168c"
format_stamp: "Formatted at 2026-08-12 11:10:00 on dist-test-slave-rmhg"
server_key: "867fa3f3fe4ed4789d7216fb587a94e2"
server_key_iv: "aeebab517d8b21fe1674605fc0820106"
server_key_version: "encryptionkey@0"
I20260812 11:10:00.827461 4615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "cc2f5b4c94a54fed86715dba7052168c"
format_stamp: "Formatted at 2026-08-12 11:10:00 on dist-test-slave-rmhg"
server_key: "867fa3f3fe4ed4789d7216fb587a94e2"
server_key_iv: "aeebab517d8b21fe1674605fc0820106"
server_key_version: "encryptionkey@0"
I20260812 11:10:00.834095 4615 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:10:00.838245 4639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:00.839902 4615 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:10:00.840130 4615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "cc2f5b4c94a54fed86715dba7052168c"
format_stamp: "Formatted at 2026-08-12 11:10:00 on dist-test-slave-rmhg"
server_key: "867fa3f3fe4ed4789d7216fb587a94e2"
server_key_iv: "aeebab517d8b21fe1674605fc0820106"
server_key_version: "encryptionkey@0"
I20260812 11:10:00.840348 4615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:00.855743 4615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:00.860532 4615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:00.860862 4615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:00.862036 4615 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:00.863590 4615 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:00.863672 4615 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:00.863777 4615 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:00.863835 4615 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:00.898413 4615 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:33945
I20260812 11:10:00.898453 4829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:33945 every 8 connection(s)
I20260812 11:10:00.899883 4615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:00.906347 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 4615
I20260812 11:10:00.906543 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:00.907011 4201 external_mini_cluster.cc:1428] Setting key ac5589d9d464fe52b7583cd17250bec8
Aug 12 11:10:00 dist-test-slave-rmhg krb5kdc[4214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533000, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:00.921754 4836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:00.902743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:39499 (local address 127.4.26.126:39275)
0812 11:10:00.903199 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:00.903204 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:00.904177 (+ 973us) server_negotiation.cc:407] Connection header received
0812 11:10:00.906161 (+ 1984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:00.906167 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:00.906256 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:00.906354 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:00.908092 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:00.908967 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:00.910726 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:00.911181 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:00.911304 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:00.915165 (+ 3861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:00.915171 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:00.915174 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:00.915214 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:00.918098 (+ 2884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:00.919119 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:00.919124 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:00.919127 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:00.919277 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:00.919769 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:00.919773 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:00.919775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:00.920085 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:00.920228 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:00.921059 (+ 831us) server_negotiation.cc:299] Negotiation successful
0812 11:10:00.921356 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":237,"threads_started":1}
I20260812 11:10:00.922824 4841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:00.903213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:39275 (local address 127.4.26.66:39499)
0812 11:10:00.903979 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:00.904041 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:00.905845 (+ 1804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:00.906655 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:00.906666 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:00.907276 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:00.907919 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:00.907939 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:00.909183 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:00.909190 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:00.910549 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:00.910565 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:00.911439 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:00.911448 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:00.911709 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:00.912427 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:00.912454 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:00.914872 (+ 2418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:00.918338 (+ 3466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:00.918352 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:00.918376 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:00.918951 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:00.919400 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:00.919406 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:00.919410 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:00.919639 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:00.920225 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:00.920235 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:00.920643 (+ 408us) client_negotiation.cc:769] Sending connection context
0812 11:10:00.920907 (+ 264us) client_negotiation.cc:240] Negotiation successful
0812 11:10:00.921577 (+ 670us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":298,"threads_started":1}
I20260812 11:10:00.924628 4832 heartbeater.cc:347] Connected to a master server at 127.4.26.126:39275
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
I20260812 11:10:00.925037 4832 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:00.925920 4832 heartbeater.cc:511] Master 127.4.26.126:39275 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
I20260812 11:10:00.927726 4291 ts_manager.cc:194] Registered new tserver with Master: cc2f5b4c94a54fed86715dba7052168c (127.4.26.66:33945)
I20260812 11:10:00.928663 4291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:39499
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:10:00.950562 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:39275
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:44859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:01.316078 4848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:01.316416 4848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:01.316517 4848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:01.324223 4848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:01.324363 4848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:01.324528 4848 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:10:01.335069 4848 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:44859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:39275
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:01.336481 4848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:01.337996 4848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:01.353235 4856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:01.353309 4858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:01.353260 4854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:01.354162 4848 server_base.cc:1034] running on GCE node
I20260812 11:10:01.354943 4848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:01.356153 4848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:01.357402 4848 hybrid_clock.cc:648] HybridClock initialized: now 1786533001357344 us; error 49 us; skew 500 ppm
I20260812 11:10:01.357779 4848 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:01 dist-test-slave-rmhg krb5kdc[4214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533001, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:01.361771 4848 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:10:01.364368 4848 webserver.cc:460] Webserver started at http://127.4.26.67:36933/ using document root <none> and password file <none>
I20260812 11:10:01.365331 4848 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:01.365500 4848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:01.365877 4848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:01.369515 4848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "bb9743dde53d4b028dfd6fee9b9e134c"
format_stamp: "Formatted at 2026-08-12 11:10:01 on dist-test-slave-rmhg"
server_key: "5b5aa9c80a9ff07ff75f20a1114be409"
server_key_iv: "fa646efb178f60e4f458c1a972141cc6"
server_key_version: "encryptionkey@0"
I20260812 11:10:01.370554 4848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "bb9743dde53d4b028dfd6fee9b9e134c"
format_stamp: "Formatted at 2026-08-12 11:10:01 on dist-test-slave-rmhg"
server_key: "5b5aa9c80a9ff07ff75f20a1114be409"
server_key_iv: "fa646efb178f60e4f458c1a972141cc6"
server_key_version: "encryptionkey@0"
I20260812 11:10:01.377692 4848 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.004s
I20260812 11:10:01.382095 4872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:01.383863 4848 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:10:01.384087 4848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "bb9743dde53d4b028dfd6fee9b9e134c"
format_stamp: "Formatted at 2026-08-12 11:10:01 on dist-test-slave-rmhg"
server_key: "5b5aa9c80a9ff07ff75f20a1114be409"
server_key_iv: "fa646efb178f60e4f458c1a972141cc6"
server_key_version: "encryptionkey@0"
I20260812 11:10:01.384325 4848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:01.403515 4607 heartbeater.cc:503] Master 127.4.26.126:39275 was elected leader, sending a full tablet report...
I20260812 11:10:01.431068 4848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:01.436211 4848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:01.436555 4848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:01.437650 4848 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:01.439194 4848 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:01.439280 4848 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:01.439410 4848 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:01.439473 4848 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:01.474009 4848 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:42169
I20260812 11:10:01.474057 5068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:42169 every 8 connection(s)
I20260812 11:10:01.475447 4848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:01.482926 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 4848
I20260812 11:10:01.483143 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:01.483580 4201 external_mini_cluster.cc:1428] Setting key 717083e220b5da55dd750a8b3b61ce23
Aug 12 11:10:01 dist-test-slave-rmhg krb5kdc[4214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533001, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:01.498044 5075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:01.478795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:42659 (local address 127.4.26.126:39275)
0812 11:10:01.479284 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:01.479290 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:01.480230 (+ 940us) server_negotiation.cc:407] Connection header received
0812 11:10:01.482368 (+ 2138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:01.482374 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:01.482517 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:01.482624 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:01.484528 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:01.485512 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:01.487240 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:01.487675 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:01.487790 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:01.491702 (+ 3912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:01.491708 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:01.491712 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:01.491749 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:01.494508 (+ 2759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:01.495387 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:01.495393 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:01.495395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:01.495535 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:01.496033 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:01.496038 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:01.496040 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:01.496343 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:01.496497 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:01.497351 (+ 854us) server_negotiation.cc:299] Negotiation successful
0812 11:10:01.497611 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":253,"threads_started":1}
I20260812 11:10:01.499231 5076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:01.479265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:39275 (local address 127.4.26.67:42659)
0812 11:10:01.480036 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:01.480085 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:01.482008 (+ 1923us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:01.482932 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:01.482943 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:01.483596 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:01.484301 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:01.484324 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:01.485676 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:01.485681 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:01.487078 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:01.487094 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:01.487921 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:01.487929 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:01.488175 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:01.488920 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:01.488947 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:01.491418 (+ 2471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:01.494699 (+ 3281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:01.494711 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:01.494729 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:01.495241 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:01.495658 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:01.495664 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:01.495666 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:01.495897 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:01.496496 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:01.496506 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:01.496893 (+ 387us) client_negotiation.cc:769] Sending connection context
0812 11:10:01.497201 (+ 308us) client_negotiation.cc:240] Negotiation successful
0812 11:10:01.497844 (+ 643us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":303,"threads_started":1}
I20260812 11:10:01.500860 5069 heartbeater.cc:347] Connected to a master server at 127.4.26.126:39275
I20260812 11:10:01.501273 5069 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:01.502089 5069 heartbeater.cc:511] Master 127.4.26.126:39275 requested a full tablet report, sending...
I20260812 11:10:01.503659 4291 ts_manager.cc:194] Registered new tserver with Master: bb9743dde53d4b028dfd6fee9b9e134c (127.4.26.67:42169)
I20260812 11:10:01.504575 4291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:42659
I20260812 11:10:01.513931 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:10:01 dist-test-slave-rmhg krb5kdc[4214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533001, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:10:01 dist-test-slave-rmhg krb5kdc[4214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533001, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:10:01.571099 5081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:01.552201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55968 (local address 127.4.26.65:42611)
0812 11:10:01.552828 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:01.552836 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:01.552868 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:10:01.552942 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:01.552949 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:01.553233 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:01.553420 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:01.555125 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:01.556291 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:01.557919 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:01.558673 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:01.558803 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:01.563832 (+ 5029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:01.563852 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:01.563875 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:01.563929 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:01.567620 (+ 3691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:01.568720 (+ 1100us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:01.568730 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:01.568732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:01.568915 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:01.569388 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:01.569393 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:01.569395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:01.569839 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:01.570103 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:01.570446 (+ 343us) server_negotiation.cc:299] Negotiation successful
0812 11:10:01.570700 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":303,"threads_started":1}
W20260812 11:10:01.572786 4473 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55968
Aug 12 11:10:01 dist-test-slave-rmhg krb5kdc[4214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:10:01 dist-test-slave-rmhg krb5kdc[4214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:10:01.628036 5081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:01.611465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55974 (local address 127.4.26.65:42611)
0812 11:10:01.611738 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:01.611746 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:01.612124 (+ 378us) server_negotiation.cc:407] Connection header received
0812 11:10:01.612360 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:01.612365 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:01.612470 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:01.612566 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:01.614246 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:01.614976 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:01.616441 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:01.616900 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:01.617032 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:01.621736 (+ 4704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:01.621742 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:01.621746 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:01.621793 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:01.624801 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:01.625752 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:01.625757 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:01.625760 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:01.625957 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:01.626419 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:01.626425 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:01.626428 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:01.626762 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:01.627016 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:01.627430 (+ 414us) server_negotiation.cc:299] Negotiation successful
0812 11:10:01.627704 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260812 11:10:01.630548 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 4396
I20260812 11:10:01.645596 5081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:01.631889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55990 (local address 127.4.26.65:42611)
0812 11:10:01.632147 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:01.632154 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:01.632459 (+ 305us) server_negotiation.cc:407] Connection header received
0812 11:10:01.632582 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:01.632586 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:01.632664 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:01.632763 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:01.634188 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:01.634962 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:01.636382 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:01.636868 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:01.636980 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:01.639566 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:01.639572 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:01.639576 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:01.639617 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:01.642443 (+ 2826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:01.643273 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:01.643278 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:01.643281 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:01.643452 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:01.643828 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:01.643834 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:01.643836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:01.644185 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:01.644486 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:01.644901 (+ 415us) server_negotiation.cc:299] Negotiation successful
0812 11:10:01.645189 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 11:10:01.646514 4598 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:01.741735 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 4396
I20260812 11:10:01.769418 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 4615
Aug 12 11:10:01 dist-test-slave-rmhg krb5kdc[4214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:10:01.788657 5093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:01.770421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45974 (local address 127.4.26.66:33945)
0812 11:10:01.771037 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:01.771048 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:01.771084 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:10:01.771149 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:01.771156 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:01.771383 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:01.771519 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:01.772871 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:01.774068 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:01.775637 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:01.776290 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:01.776416 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:01.781434 (+ 5018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:01.781455 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:01.781476 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:01.781522 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:01.785077 (+ 3555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:01.786080 (+ 1003us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:01.786091 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:01.786093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:01.786297 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:01.786793 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:01.786798 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:01.786800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:01.787264 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:01.787532 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:01.787974 (+ 442us) server_negotiation.cc:299] Negotiation successful
0812 11:10:01.788263 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":360,"threads_started":1}
I20260812 11:10:01.790297 4821 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:01.873819 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 4615
I20260812 11:10:01.897866 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 4848
Aug 12 11:10:01 dist-test-slave-rmhg krb5kdc[4214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533001, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:10:01.916662 5095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:01.898914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32978 (local address 127.4.26.67:42169)
0812 11:10:01.899545 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:01.899553 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:01.899586 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:10:01.899690 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:01.899697 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:01.899927 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:01.900066 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:01.901535 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:01.902627 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:01.904146 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:01.904811 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:01.904934 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:01.909712 (+ 4778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:01.909733 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:01.909761 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:01.909823 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:01.913010 (+ 3187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:01.914050 (+ 1040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:01.914061 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:01.914063 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:01.914240 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:01.914798 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:01.914802 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:01.914804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:01.915252 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:01.915510 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:01.915960 (+ 450us) server_negotiation.cc:299] Negotiation successful
0812 11:10:01.916322 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":315,"threads_started":1}
I20260812 11:10:01.918152 5055 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:02.002286 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 4848
I20260812 11:10:02.023104 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 4241
I20260812 11:10:02.024334 4346 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:02.128881 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 4241
2026-08-12T11:10:02Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4461 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:02 dist-test-slave-rmhg krb5kdc[5101](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:02 dist-test-slave-rmhg krb5kdc[5101](info): set up 2 sockets
Aug 12 11:10:02 dist-test-slave-rmhg krb5kdc[5101](info): commencing operation
krb5kdc: starting...
W20260812 11:10:03.381940 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.000s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:10:03 dist-test-slave-rmhg krb5kdc[5101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:10:03.595237 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:43045
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:36207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:43045
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:03.952639 5124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:03.952978 5124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:03.953099 5124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:03.960937 5124 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:03.961071 5124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:03.961125 5124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:03.961230 5124 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:03.961292 5124 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:03.971889 5124 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:36207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:43045
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:43045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:03.973428 5124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:03.974901 5124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:03.988312 5133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:03.988265 5136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:03.988358 5134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:03.990965 5124 server_base.cc:1034] running on GCE node
I20260812 11:10:03.991953 5124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:03.993733 5124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:03.995035 5124 hybrid_clock.cc:648] HybridClock initialized: now 1786533003994946 us; error 67 us; skew 500 ppm
I20260812 11:10:03.995522 5124 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:03 dist-test-slave-rmhg krb5kdc[5101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533003, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:03.999128 5124 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:10:04.001035 5124 webserver.cc:460] Webserver started at http://127.4.26.126:35123/ using document root <none> and password file <none>
I20260812 11:10:04.001916 5124 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:04.002058 5124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:04.002420 5124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:04.006256 5124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "4db9472e22894ac6bddc1bdd442bd16b"
format_stamp: "Formatted at 2026-08-12 11:10:03 on dist-test-slave-rmhg"
server_key: "d59823f760cc5be84eb3ae04d1eb6384"
server_key_iv: "95f5f055de0b38ff631990cc271c3c49"
server_key_version: "encryptionkey@0"
I20260812 11:10:04.007162 5124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "4db9472e22894ac6bddc1bdd442bd16b"
format_stamp: "Formatted at 2026-08-12 11:10:03 on dist-test-slave-rmhg"
server_key: "d59823f760cc5be84eb3ae04d1eb6384"
server_key_iv: "95f5f055de0b38ff631990cc271c3c49"
server_key_version: "encryptionkey@0"
I20260812 11:10:04.013355 5124 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:10:04.017432 5152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:04.019076 5124 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:10:04.019281 5124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "4db9472e22894ac6bddc1bdd442bd16b"
format_stamp: "Formatted at 2026-08-12 11:10:03 on dist-test-slave-rmhg"
server_key: "d59823f760cc5be84eb3ae04d1eb6384"
server_key_iv: "95f5f055de0b38ff631990cc271c3c49"
server_key_version: "encryptionkey@0"
I20260812 11:10:04.019516 5124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:04.037657 5124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:04.042668 5124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:04.043015 5124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:04.062242 5124 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:43045
I20260812 11:10:04.062302 5233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:43045 every 8 connection(s)
I20260812 11:10:04.063808 5124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:04.067358 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 5124
I20260812 11:10:04.067623 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:10:04.068511 4201 external_mini_cluster.cc:1428] Setting key ffb209dd4ae671c26499842efbc149ae
I20260812 11:10:04.068773 5235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:04.085626 5235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b: Bootstrap starting.
Aug 12 11:10:04 dist-test-slave-rmhg krb5kdc[5101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:04.090006 5235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:04.091361 5235 log.cc:824] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:04.094724 5235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b: No bootstrap required, opened a new log
I20260812 11:10:04.096431 5239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:04.071280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50048 (local address 127.4.26.126:43045)
0812 11:10:04.072215 (+ 935us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:04.072232 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:04.072283 (+ 51us) server_negotiation.cc:407] Connection header received
0812 11:10:04.074664 (+ 2381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:04.074703 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:04.075407 (+ 704us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:04.075911 (+ 504us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:04.078025 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:04.079570 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:04.081612 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:04.082525 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:04.082709 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:04.088203 (+ 5494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:04.088215 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:04.088235 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:04.088286 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:04.091885 (+ 3599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:04.092714 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:04.092723 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:04.092731 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:04.092935 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:04.093390 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:04.093393 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:04.093396 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:04.093985 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:04.094306 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:04.094876 (+ 570us) server_negotiation.cc:299] Negotiation successful
0812 11:10:04.095346 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":685,"thread_start_us":434,"threads_started":1}
I20260812 11:10:04.103613 5235 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4db9472e22894ac6bddc1bdd442bd16b" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43045 } }
I20260812 11:10:04.104197 5235 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:04.104338 5235 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4db9472e22894ac6bddc1bdd442bd16b, State: Initialized, Role: FOLLOWER
I20260812 11:10:04.105085 5235 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4db9472e22894ac6bddc1bdd442bd16b" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43045 } }
I20260812 11:10:04.105365 5235 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:04.105497 5235 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:04.105644 5235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:04.107895 5235 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4db9472e22894ac6bddc1bdd442bd16b" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43045 } }
I20260812 11:10:04.108443 5235 leader_election.cc:302] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4db9472e22894ac6bddc1bdd442bd16b; no voters:
I20260812 11:10:04.109078 5235 leader_election.cc:288] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:04.109251 5243 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:04.110479 5243 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [term 1 LEADER]: Becoming Leader. State: Replica: 4db9472e22894ac6bddc1bdd442bd16b, State: Running, Role: LEADER
I20260812 11:10:04.111029 5243 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4db9472e22894ac6bddc1bdd442bd16b" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43045 } }
I20260812 11:10:04.111423 5235 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:04.113894 5245 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4db9472e22894ac6bddc1bdd442bd16b. Latest consensus state: current_term: 1 leader_uuid: "4db9472e22894ac6bddc1bdd442bd16b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4db9472e22894ac6bddc1bdd442bd16b" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43045 } } }
I20260812 11:10:04.114346 5245 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:04.114926 5244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4db9472e22894ac6bddc1bdd442bd16b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4db9472e22894ac6bddc1bdd442bd16b" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43045 } } }
I20260812 11:10:04.115252 5244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:04.116709 5250 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:04.122889 5250 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:04.133270 5250 catalog_manager.cc:1347] Generated new cluster ID: c4745bc319a447e0b9bc52d60452ea8f
I20260812 11:10:04.133411 5250 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:04.146173 5250 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:04.148280 5250 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:04.155889 5250 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4db9472e22894ac6bddc1bdd442bd16b: Generated new TSK 0
I20260812 11:10:04.157102 5250 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:10:04.206898 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:43045
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:36207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:04.564105 5271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:04.564453 5271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:04.564572 5271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:04.572111 5271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:04.572263 5271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:04.572386 5271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:10:04.582798 5271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:36207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:43045
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:04.584170 5271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:04.585654 5271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:04.600466 5279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:04.600492 5278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:04.601197 5271 server_base.cc:1034] running on GCE node
W20260812 11:10:04.601261 5283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:04.601958 5271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:04.603039 5271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:04.604278 5271 hybrid_clock.cc:648] HybridClock initialized: now 1786533004604220 us; error 51 us; skew 500 ppm
I20260812 11:10:04.604668 5271 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:04 dist-test-slave-rmhg krb5kdc[5101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533004, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:04.608127 5271 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:10:04.609884 5271 webserver.cc:460] Webserver started at http://127.4.26.65:32803/ using document root <none> and password file <none>
I20260812 11:10:04.610672 5271 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:04.610810 5271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:04.611182 5271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:04.614624 5271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "dcea812991434689a018cb053b23d702"
format_stamp: "Formatted at 2026-08-12 11:10:04 on dist-test-slave-rmhg"
server_key: "80ce16e8ae7a480eacb0385d2b1b0829"
server_key_iv: "f167483d6c9f2e4fa16fdc6f8cd0defc"
server_key_version: "encryptionkey@0"
I20260812 11:10:04.615497 5271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "dcea812991434689a018cb053b23d702"
format_stamp: "Formatted at 2026-08-12 11:10:04 on dist-test-slave-rmhg"
server_key: "80ce16e8ae7a480eacb0385d2b1b0829"
server_key_iv: "f167483d6c9f2e4fa16fdc6f8cd0defc"
server_key_version: "encryptionkey@0"
I20260812 11:10:04.621963 5271 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260812 11:10:04.626080 5292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:04.628126 5271 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:10:04.628337 5271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "dcea812991434689a018cb053b23d702"
format_stamp: "Formatted at 2026-08-12 11:10:04 on dist-test-slave-rmhg"
server_key: "80ce16e8ae7a480eacb0385d2b1b0829"
server_key_iv: "f167483d6c9f2e4fa16fdc6f8cd0defc"
server_key_version: "encryptionkey@0"
I20260812 11:10:04.628571 5271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:04.643941 5271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:04.648180 5271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:04.648486 5271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:04.649574 5271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:04.651010 5271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:04.651104 5271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:04.651233 5271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:04.651296 5271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:04.683687 5271 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:40813
I20260812 11:10:04.683741 5474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:40813 every 8 connection(s)
I20260812 11:10:04.685096 5271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:04.688475 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 5271
I20260812 11:10:04.688716 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:04.689383 4201 external_mini_cluster.cc:1428] Setting key aae43cc284506224869a127701312203
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
Aug 12 11:10:04 dist-test-slave-rmhg krb5kdc[5101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533004, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:04.725790 5477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:04.691545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:45859 (local address 127.4.26.126:43045)
0812 11:10:04.692135 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:04.692143 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:04.693592 (+ 1449us) server_negotiation.cc:407] Connection header received
0812 11:10:04.696364 (+ 2772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:04.696370 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:04.696472 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:04.696581 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:04.700793 (+ 4212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:04.701970 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:04.704980 (+ 3010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:04.705698 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:04.705832 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:04.717429 (+ 11597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:04.717438 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:04.717443 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:04.717500 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:04.721321 (+ 3821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:04.722714 (+ 1393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:04.722721 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:04.722725 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:04.722907 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:04.723546 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:04.723551 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:04.723555 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:04.723969 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:04.724088 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:04.725107 (+ 1019us) server_negotiation.cc:299] Negotiation successful
0812 11:10:04.725414 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":296,"threads_started":1}
I20260812 11:10:04.727141 5478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:04.692179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43045 (local address 127.4.26.65:45859)
0812 11:10:04.693301 (+ 1122us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:04.693379 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:04.695925 (+ 2546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:04.696921 (+ 996us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:04.696935 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:04.699613 (+ 2678us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:04.700530 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:04.700563 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:04.702257 (+ 1694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:04.702264 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:04.704716 (+ 2452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:04.704742 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:04.706255 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:04.706263 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:04.706609 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:04.710635 (+ 4026us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:04.710674 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:04.716948 (+ 6274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:04.721634 (+ 4686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:04.721651 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:04.721679 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:04.722508 (+ 829us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:04.723083 (+ 575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:04.723088 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:04.723091 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:04.723387 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:04.724232 (+ 845us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:04.724239 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:04.724664 (+ 425us) client_negotiation.cc:769] Sending connection context
0812 11:10:04.724971 (+ 307us) client_negotiation.cc:240] Negotiation successful
0812 11:10:04.725619 (+ 648us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":398,"threads_started":1}
I20260812 11:10:04.729084 5475 heartbeater.cc:347] Connected to a master server at 127.4.26.126:43045
I20260812 11:10:04.729547 5475 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:04.730525 5475 heartbeater.cc:511] Master 127.4.26.126:43045 requested a full tablet report, sending...
I20260812 11:10:04.733500 5181 ts_manager.cc:194] Registered new tserver with Master: dcea812991434689a018cb053b23d702 (127.4.26.65:40813)
I20260812 11:10:04.735710 5181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:45859
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:10:04.744886 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:43045
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:36207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:05.112592 5482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:05.112982 5482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:05.113184 5482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:05.120909 5482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:05.121065 5482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:05.121258 5482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:10:05.131740 5482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:36207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:43045
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:05.133371 5482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:05.134853 5482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:05.149224 5498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:05.149201 5495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:05.149520 5494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:05.150116 5482 server_base.cc:1034] running on GCE node
I20260812 11:10:05.150774 5482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:05.151823 5482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:05.153031 5482 hybrid_clock.cc:648] HybridClock initialized: now 1786533005152967 us; error 62 us; skew 500 ppm
I20260812 11:10:05.153379 5482 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:05 dist-test-slave-rmhg krb5kdc[5101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533005, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:05.156913 5482 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:10:05.158674 5482 webserver.cc:460] Webserver started at http://127.4.26.66:43453/ using document root <none> and password file <none>
I20260812 11:10:05.159435 5482 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:05.159556 5482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:05.159916 5482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:05.163270 5482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "e5c0eebd829645b786dac238875068e5"
format_stamp: "Formatted at 2026-08-12 11:10:05 on dist-test-slave-rmhg"
server_key: "85971076a8975b31d06da7dfcd2428ca"
server_key_iv: "0acb90d0951f0432e1c0ecc59763fe60"
server_key_version: "encryptionkey@0"
I20260812 11:10:05.164171 5482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "e5c0eebd829645b786dac238875068e5"
format_stamp: "Formatted at 2026-08-12 11:10:05 on dist-test-slave-rmhg"
server_key: "85971076a8975b31d06da7dfcd2428ca"
server_key_iv: "0acb90d0951f0432e1c0ecc59763fe60"
server_key_version: "encryptionkey@0"
I20260812 11:10:05.170205 5482 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 11:10:05.174774 5508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:05.176520 5482 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260812 11:10:05.176760 5482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "e5c0eebd829645b786dac238875068e5"
format_stamp: "Formatted at 2026-08-12 11:10:05 on dist-test-slave-rmhg"
server_key: "85971076a8975b31d06da7dfcd2428ca"
server_key_iv: "0acb90d0951f0432e1c0ecc59763fe60"
server_key_version: "encryptionkey@0"
I20260812 11:10:05.177009 5482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:05.204533 5482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:05.210033 5482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:05.210378 5482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:05.211585 5482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:05.213367 5482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:05.213461 5482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:05.213565 5482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:05.213642 5482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:05.250033 5482 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:40703
I20260812 11:10:05.250108 5694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:40703 every 8 connection(s)
I20260812 11:10:05.251399 5482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:05.258111 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 5482
I20260812 11:10:05.258313 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:05.258930 4201 external_mini_cluster.cc:1428] Setting key afbd3a5c82bd711bfa478df5e70e02e0
Aug 12 11:10:05 dist-test-slave-rmhg krb5kdc[5101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533005, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:05.276346 5698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:05.254323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:45423 (local address 127.4.26.126:43045)
0812 11:10:05.254799 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:05.254804 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:05.255978 (+ 1174us) server_negotiation.cc:407] Connection header received
0812 11:10:05.258053 (+ 2075us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:05.258059 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:05.258145 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:05.258260 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:05.260452 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.261563 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.264053 (+ 2490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.264519 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.264627 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:05.269062 (+ 4435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:05.269071 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:05.269076 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:05.269125 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:05.272480 (+ 3355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:05.273578 (+ 1098us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:05.273585 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:05.273588 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:05.273800 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:05.274305 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:05.274311 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:05.274314 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:05.274699 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:05.274849 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:05.275692 (+ 843us) server_negotiation.cc:299] Negotiation successful
0812 11:10:05.275947 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":265,"threads_started":1}
I20260812 11:10:05.277362 5700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:05.254954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43045 (local address 127.4.26.66:45423)
0812 11:10:05.255783 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:05.255823 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:05.257737 (+ 1914us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:05.258596 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:05.258610 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:05.259435 (+ 825us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:05.260251 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:05.260275 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.261746 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.261753 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:05.263849 (+ 2096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:05.263867 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.264783 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.264790 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:05.265103 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:05.265961 (+ 858us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:05.265994 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:05.268734 (+ 2740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:05.272736 (+ 4002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:05.272747 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:05.272765 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:05.273402 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:05.273939 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:05.273943 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:05.273946 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:05.274179 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:05.274867 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:05.274875 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:05.275270 (+ 395us) client_negotiation.cc:769] Sending connection context
0812 11:10:05.275534 (+ 264us) client_negotiation.cc:240] Negotiation successful
0812 11:10:05.276078 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":353,"threads_started":1}
I20260812 11:10:05.279223 5696 heartbeater.cc:347] Connected to a master server at 127.4.26.126:43045
I20260812 11:10:05.279609 5696 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
I20260812 11:10:05.280438 5696 heartbeater.cc:511] Master 127.4.26.126:43045 requested a full tablet report, sending...
I20260812 11:10:05.282418 5181 ts_manager.cc:194] Registered new tserver with Master: e5c0eebd829645b786dac238875068e5 (127.4.26.66:40703)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
I20260812 11:10:05.283340 5181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:45423
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:10:05.309298 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:43045
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:36207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:05.656859 5707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:05.657231 5707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:05.657373 5707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:05.664870 5707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:05.665032 5707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:05.665239 5707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:10:05.676110 5707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:36207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:43045
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:05.677629 5707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:05.679100 5707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:05.693867 5715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:05.693939 5716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:05.693897 5718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:05.694595 5707 server_base.cc:1034] running on GCE node
I20260812 11:10:05.695272 5707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:05.696281 5707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:05.697506 5707 hybrid_clock.cc:648] HybridClock initialized: now 1786533005697448 us; error 53 us; skew 500 ppm
I20260812 11:10:05.697846 5707 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:05 dist-test-slave-rmhg krb5kdc[5101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533005, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:05.701432 5707 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:10:05.703102 5707 webserver.cc:460] Webserver started at http://127.4.26.67:43933/ using document root <none> and password file <none>
I20260812 11:10:05.703828 5707 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:05.703944 5707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:05.704288 5707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:05.707489 5707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "2fb450c77f4f4d339a6c47ac86db00ca"
format_stamp: "Formatted at 2026-08-12 11:10:05 on dist-test-slave-rmhg"
server_key: "3c6f5cc628cb5abe882b7a22b4720d99"
server_key_iv: "a417f495b2af4151608a3a5a5cb14a80"
server_key_version: "encryptionkey@0"
I20260812 11:10:05.708384 5707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "2fb450c77f4f4d339a6c47ac86db00ca"
format_stamp: "Formatted at 2026-08-12 11:10:05 on dist-test-slave-rmhg"
server_key: "3c6f5cc628cb5abe882b7a22b4720d99"
server_key_iv: "a417f495b2af4151608a3a5a5cb14a80"
server_key_version: "encryptionkey@0"
I20260812 11:10:05.714352 5707 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:10:05.718263 5729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:05.719944 5707 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:10:05.720167 5707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "2fb450c77f4f4d339a6c47ac86db00ca"
format_stamp: "Formatted at 2026-08-12 11:10:05 on dist-test-slave-rmhg"
server_key: "3c6f5cc628cb5abe882b7a22b4720d99"
server_key_iv: "a417f495b2af4151608a3a5a5cb14a80"
server_key_version: "encryptionkey@0"
I20260812 11:10:05.720381 5707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:05.739698 5475 heartbeater.cc:503] Master 127.4.26.126:43045 was elected leader, sending a full tablet report...
I20260812 11:10:05.751185 5707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:05.756583 5707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:05.756911 5707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:05.758082 5707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:05.759692 5707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:05.759783 5707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:05.759909 5707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:05.759972 5707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:05.793634 5707 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:33331
I20260812 11:10:05.793712 5924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:33331 every 8 connection(s)
I20260812 11:10:05.795061 5707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:05.800670 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 5707
I20260812 11:10:05.800881 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:05.801407 4201 external_mini_cluster.cc:1428] Setting key 164576ec02e17094a20150089e5827b3
Aug 12 11:10:05 dist-test-slave-rmhg krb5kdc[5101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533005, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:05.819271 5929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:05.798084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:41675 (local address 127.4.26.126:43045)
0812 11:10:05.798615 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:05.798622 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:05.799989 (+ 1367us) server_negotiation.cc:407] Connection header received
0812 11:10:05.802367 (+ 2378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:05.802374 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:05.802499 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:05.802649 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:05.804980 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.806024 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.807843 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.808261 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.808365 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:05.812633 (+ 4268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:05.812639 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:05.812642 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:05.812683 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:05.815280 (+ 2597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:05.816334 (+ 1054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:05.816339 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:05.816341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:05.816551 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:05.817253 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:05.817260 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:05.817262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:05.817671 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:05.817825 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:05.818751 (+ 926us) server_negotiation.cc:299] Negotiation successful
0812 11:10:05.818968 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":225,"threads_started":1}
I20260812 11:10:05.820358 5930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:05.798772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43045 (local address 127.4.26.67:41675)
0812 11:10:05.799739 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:05.799813 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:05.801939 (+ 2126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:05.803106 (+ 1167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:05.803118 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:05.803756 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:05.804709 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:05.804745 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.806228 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.806233 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:05.807668 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:05.807685 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.808493 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.808501 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:05.808735 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:05.809507 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:05.809533 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:05.812312 (+ 2779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:05.815487 (+ 3175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:05.815497 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:05.815514 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:05.816181 (+ 667us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:05.816741 (+ 560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:05.816752 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:05.816755 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:05.817083 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:05.817814 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:05.817824 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:05.818282 (+ 458us) client_negotiation.cc:769] Sending connection context
0812 11:10:05.818663 (+ 381us) client_negotiation.cc:240] Negotiation successful
0812 11:10:05.819159 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":390,"threads_started":1}
I20260812 11:10:05.821996 5926 heartbeater.cc:347] Connected to a master server at 127.4.26.126:43045
I20260812 11:10:05.822389 5926 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:05.823238 5926 heartbeater.cc:511] Master 127.4.26.126:43045 requested a full tablet report, sending...
I20260812 11:10:05.825091 5181 ts_manager.cc:194] Registered new tserver with Master: 2fb450c77f4f4d339a6c47ac86db00ca (127.4.26.67:33331)
I20260812 11:10:05.826054 5181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:41675
I20260812 11:10:05.831115 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:10:05.854141 5929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:05.839226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50064 (local address 127.4.26.126:43045)
0812 11:10:05.839465 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:05.839471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:05.840000 (+ 529us) server_negotiation.cc:407] Connection header received
0812 11:10:05.840199 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:05.840203 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:05.840296 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:05.840396 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:05.842211 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.843056 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.844585 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.845017 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.845212 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:05.847843 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:05.847848 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:05.847852 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:05.847895 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:05.850983 (+ 3088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:05.851879 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:05.851884 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:05.851887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:05.852052 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:05.852527 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:05.852532 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:05.852534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:05.852912 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:05.853135 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:05.853669 (+ 534us) server_negotiation.cc:299] Negotiation successful
0812 11:10:05.853893 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 11:10:05.863605 5181 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50064:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:10:05.872841 5181 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:05.902458 5953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:05.891016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:33331 (local address 127.0.0.1:34658)
0812 11:10:05.891804 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:05.891867 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:05.892114 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:05.893478 (+ 1364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:05.893487 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:05.893526 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:05.893981 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:05.893994 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.896509 (+ 2515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.896517 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:05.899411 (+ 2894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:05.899429 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.901405 (+ 1976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.901412 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:05.901637 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:05.901702 (+ 65us) client_negotiation.cc:769] Sending connection context
0812 11:10:05.901812 (+ 110us) client_negotiation.cc:240] Negotiation successful
0812 11:10:05.902022 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":325,"threads_started":1}
I20260812 11:10:05.903162 5955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:05.891299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34658 (local address 127.4.26.67:33331)
0812 11:10:05.892671 (+ 1372us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:05.892682 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:05.892720 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:10:05.892842 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:05.892852 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:05.893192 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:05.894207 (+ 1015us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:05.894532 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.896301 (+ 1769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.899632 (+ 3331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.901143 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.902266 (+ 1123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:05.902530 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:05.902619 (+ 89us) server_negotiation.cc:299] Negotiation successful
0812 11:10:05.902802 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1139,"thread_start_us":1782,"threads_started":1}
I20260812 11:10:05.907454 5962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:05.891861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:40703 (local address 127.0.0.1:36156)
0812 11:10:05.898185 (+ 6324us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:05.898208 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:05.898454 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:05.899802 (+ 1348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:05.899807 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:05.899837 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:05.900230 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:05.900243 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.902175 (+ 1932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.902181 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:05.904533 (+ 2352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:05.904549 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.906513 (+ 1964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.906524 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:05.906751 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:05.906785 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:10:05.906872 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 11:10:05.907015 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6172,"mutex_wait_us":49,"thread_start_us":6814,"threads_started":1}
I20260812 11:10:05.907907 5957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:05.892741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:40813 (local address 127.0.0.1:49612)
0812 11:10:05.898917 (+ 6176us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:05.898931 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:05.899023 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:05.900288 (+ 1265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:05.900293 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:05.900317 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:05.900631 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:05.900639 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.902654 (+ 2015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.902660 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:05.904765 (+ 2105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:05.904775 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.906307 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.906315 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:05.906507 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:05.907185 (+ 678us) client_negotiation.cc:769] Sending connection context
0812 11:10:05.907274 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 11:10:05.907423 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6077,"mutex_wait_us":597,"thread_start_us":5112,"threads_started":1}
I20260812 11:10:05.908005 5960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:05.892056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49612 (local address 127.4.26.65:40813)
0812 11:10:05.899716 (+ 7660us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:05.899725 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:05.899754 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:10:05.899859 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:05.899866 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:05.900099 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:05.900285 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:05.900973 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.902487 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.904902 (+ 2415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.906058 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.906623 (+ 565us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:05.906876 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:05.907329 (+ 453us) server_negotiation.cc:299] Negotiation successful
0812 11:10:05.907513 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7485,"thread_start_us":7331,"threads_started":1}
I20260812 11:10:05.908571 5961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:05.892384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36156 (local address 127.4.26.66:40703)
0812 11:10:05.894296 (+ 1912us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:05.894305 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:05.898330 (+ 4025us) server_negotiation.cc:407] Connection header received
0812 11:10:05.899235 (+ 905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:05.899244 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:05.899571 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:05.899804 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:05.900454 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.902036 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.904719 (+ 2683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:05.906255 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:05.907767 (+ 1512us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:05.907977 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:05.908058 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 11:10:05.908246 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1752,"thread_start_us":1619,"threads_started":1}
I20260812 11:10:05.908778 5821 tablet_service.cc:1467] Processing CreateTablet for tablet e891e67793fd41ec8b69dbe5970fc135 (DEFAULT_TABLE table=test-table [id=deda5d959fae4a29acd9cc430ad7f87e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:05.910820 5821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e891e67793fd41ec8b69dbe5970fc135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:05.912896 5588 tablet_service.cc:1467] Processing CreateTablet for tablet e891e67793fd41ec8b69dbe5970fc135 (DEFAULT_TABLE table=test-table [id=deda5d959fae4a29acd9cc430ad7f87e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:05.913786 5370 tablet_service.cc:1467] Processing CreateTablet for tablet e891e67793fd41ec8b69dbe5970fc135 (DEFAULT_TABLE table=test-table [id=deda5d959fae4a29acd9cc430ad7f87e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:05.914559 5588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e891e67793fd41ec8b69dbe5970fc135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:05.915050 5370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e891e67793fd41ec8b69dbe5970fc135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:05.927585 5964 tablet_bootstrap.cc:492] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702: Bootstrap starting.
I20260812 11:10:05.930061 5965 tablet_bootstrap.cc:492] T e891e67793fd41ec8b69dbe5970fc135 P 2fb450c77f4f4d339a6c47ac86db00ca: Bootstrap starting.
I20260812 11:10:05.931193 5966 tablet_bootstrap.cc:492] T e891e67793fd41ec8b69dbe5970fc135 P e5c0eebd829645b786dac238875068e5: Bootstrap starting.
I20260812 11:10:05.932083 5964 tablet_bootstrap.cc:654] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:05.933759 5964 log.cc:824] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:05.934037 5965 tablet_bootstrap.cc:654] T e891e67793fd41ec8b69dbe5970fc135 P 2fb450c77f4f4d339a6c47ac86db00ca: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:05.934916 5966 tablet_bootstrap.cc:654] T e891e67793fd41ec8b69dbe5970fc135 P e5c0eebd829645b786dac238875068e5: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:05.935436 5965 log.cc:824] T e891e67793fd41ec8b69dbe5970fc135 P 2fb450c77f4f4d339a6c47ac86db00ca: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:05.936151 5966 log.cc:824] T e891e67793fd41ec8b69dbe5970fc135 P e5c0eebd829645b786dac238875068e5: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:05.938913 5965 tablet_bootstrap.cc:492] T e891e67793fd41ec8b69dbe5970fc135 P 2fb450c77f4f4d339a6c47ac86db00ca: No bootstrap required, opened a new log
I20260812 11:10:05.939260 5965 ts_tablet_manager.cc:1397] T e891e67793fd41ec8b69dbe5970fc135 P 2fb450c77f4f4d339a6c47ac86db00ca: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260812 11:10:05.939564 5964 tablet_bootstrap.cc:492] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702: No bootstrap required, opened a new log
I20260812 11:10:05.939582 5966 tablet_bootstrap.cc:492] T e891e67793fd41ec8b69dbe5970fc135 P e5c0eebd829645b786dac238875068e5: No bootstrap required, opened a new log
I20260812 11:10:05.939903 5966 ts_tablet_manager.cc:1397] T e891e67793fd41ec8b69dbe5970fc135 P e5c0eebd829645b786dac238875068e5: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 11:10:05.939903 5964 ts_tablet_manager.cc:1397] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.004s
I20260812 11:10:05.947454 5965 raft_consensus.cc:348] T e891e67793fd41ec8b69dbe5970fc135 P 2fb450c77f4f4d339a6c47ac86db00ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb450c77f4f4d339a6c47ac86db00ca" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33331 } } peers { permanent_uuid: "e5c0eebd829645b786dac238875068e5" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40703 } } peers { permanent_uuid: "dcea812991434689a018cb053b23d702" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40813 } }
I20260812 11:10:05.947890 5965 raft_consensus.cc:374] T e891e67793fd41ec8b69dbe5970fc135 P 2fb450c77f4f4d339a6c47ac86db00ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:05.948004 5965 raft_consensus.cc:729] T e891e67793fd41ec8b69dbe5970fc135 P 2fb450c77f4f4d339a6c47ac86db00ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb450c77f4f4d339a6c47ac86db00ca, State: Initialized, Role: FOLLOWER
I20260812 11:10:05.948671 5965 consensus_queue.cc:260] T e891e67793fd41ec8b69dbe5970fc135 P 2fb450c77f4f4d339a6c47ac86db00ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb450c77f4f4d339a6c47ac86db00ca" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33331 } } peers { permanent_uuid: "e5c0eebd829645b786dac238875068e5" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40703 } } peers { permanent_uuid: "dcea812991434689a018cb053b23d702" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40813 } }
I20260812 11:10:05.950069 5926 heartbeater.cc:503] Master 127.4.26.126:43045 was elected leader, sending a full tablet report...
I20260812 11:10:05.950939 5966 raft_consensus.cc:348] T e891e67793fd41ec8b69dbe5970fc135 P e5c0eebd829645b786dac238875068e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb450c77f4f4d339a6c47ac86db00ca" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33331 } } peers { permanent_uuid: "e5c0eebd829645b786dac238875068e5" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40703 } } peers { permanent_uuid: "dcea812991434689a018cb053b23d702" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40813 } }
I20260812 11:10:05.951128 5964 raft_consensus.cc:348] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb450c77f4f4d339a6c47ac86db00ca" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33331 } } peers { permanent_uuid: "e5c0eebd829645b786dac238875068e5" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40703 } } peers { permanent_uuid: "dcea812991434689a018cb053b23d702" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40813 } }
I20260812 11:10:05.951486 5966 raft_consensus.cc:374] T e891e67793fd41ec8b69dbe5970fc135 P e5c0eebd829645b786dac238875068e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:05.951509 5964 raft_consensus.cc:374] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:05.951612 5964 raft_consensus.cc:729] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcea812991434689a018cb053b23d702, State: Initialized, Role: FOLLOWER
I20260812 11:10:05.951606 5966 raft_consensus.cc:729] T e891e67793fd41ec8b69dbe5970fc135 P e5c0eebd829645b786dac238875068e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5c0eebd829645b786dac238875068e5, State: Initialized, Role: FOLLOWER
I20260812 11:10:05.952550 5965 ts_tablet_manager.cc:1428] T e891e67793fd41ec8b69dbe5970fc135 P 2fb450c77f4f4d339a6c47ac86db00ca: Time spent starting tablet: real 0.013s user 0.008s sys 0.004s
I20260812 11:10:05.952379 5964 consensus_queue.cc:260] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb450c77f4f4d339a6c47ac86db00ca" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33331 } } peers { permanent_uuid: "e5c0eebd829645b786dac238875068e5" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40703 } } peers { permanent_uuid: "dcea812991434689a018cb053b23d702" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40813 } }
I20260812 11:10:05.952379 5966 consensus_queue.cc:260] T e891e67793fd41ec8b69dbe5970fc135 P e5c0eebd829645b786dac238875068e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb450c77f4f4d339a6c47ac86db00ca" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33331 } } peers { permanent_uuid: "e5c0eebd829645b786dac238875068e5" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40703 } } peers { permanent_uuid: "dcea812991434689a018cb053b23d702" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40813 } }
I20260812 11:10:05.954221 5696 heartbeater.cc:503] Master 127.4.26.126:43045 was elected leader, sending a full tablet report...
I20260812 11:10:05.954463 5964 ts_tablet_manager.cc:1428] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702: Time spent starting tablet: real 0.014s user 0.009s sys 0.006s
I20260812 11:10:05.955997 5966 ts_tablet_manager.cc:1428] T e891e67793fd41ec8b69dbe5970fc135 P e5c0eebd829645b786dac238875068e5: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
W20260812 11:10:06.003682 5697 tablet.cc:2369] T e891e67793fd41ec8b69dbe5970fc135 P e5c0eebd829645b786dac238875068e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:10:06.047000 5927 tablet.cc:2369] T e891e67793fd41ec8b69dbe5970fc135 P 2fb450c77f4f4d339a6c47ac86db00ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:06.058733 5972 raft_consensus.cc:482] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:06.059078 5972 raft_consensus.cc:504] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb450c77f4f4d339a6c47ac86db00ca" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33331 } } peers { permanent_uuid: "e5c0eebd829645b786dac238875068e5" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40703 } } peers { permanent_uuid: "dcea812991434689a018cb053b23d702" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40813 } }
I20260812 11:10:06.061506 5972 leader_election.cc:288] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fb450c77f4f4d339a6c47ac86db00ca (127.4.26.67:33331), e5c0eebd829645b786dac238875068e5 (127.4.26.66:40703)
I20260812 11:10:06.069931 5961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:06.062113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:33673 (local address 127.4.26.66:40703)
0812 11:10:06.062354 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:06.062360 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:06.063643 (+ 1283us) server_negotiation.cc:407] Connection header received
0812 11:10:06.063843 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:06.063849 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:06.063925 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:06.063989 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:06.064759 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.065694 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.067552 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.068784 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.068944 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:06.069060 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:06.069495 (+ 435us) server_negotiation.cc:299] Negotiation successful
0812 11:10:06.069657 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:10:06.069953 5955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:06.062042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:36969 (local address 127.4.26.67:33331)
0812 11:10:06.062264 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:06.062270 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:06.063199 (+ 929us) server_negotiation.cc:407] Connection header received
0812 11:10:06.063515 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:06.063520 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:06.063598 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:06.063695 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:06.064255 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.065189 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.067736 (+ 2547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.068948 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.069055 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:06.069193 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:06.069600 (+ 407us) server_negotiation.cc:299] Negotiation successful
0812 11:10:06.069728 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 11:10:06.069947 5976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:06.062694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:40703 (local address 127.4.26.65:33673)
0812 11:10:06.063510 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:06.063530 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:06.063670 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:06.064188 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:06.064193 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:06.064217 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:06.064565 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:06.064576 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.065845 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.065849 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:06.067372 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:06.067387 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.069046 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.069054 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:06.069289 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:06.069332 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 11:10:06.069434 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 11:10:06.069580 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":501,"threads_started":1}
I20260812 11:10:06.070775 5975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:06.062172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:33331 (local address 127.4.26.65:36969)
0812 11:10:06.063047 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:06.063073 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:06.063355 (+ 282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:06.063743 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:06.063748 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:06.063776 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:06.064100 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:06.064111 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.065322 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.065328 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:06.067564 (+ 2236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:06.067581 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.069266 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.069272 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:06.069405 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:06.069439 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:10:06.070299 (+ 860us) client_negotiation.cc:240] Negotiation successful
0812 11:10:06.070450 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"thread_start_us":788,"threads_started":1}
I20260812 11:10:06.071410 5619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e891e67793fd41ec8b69dbe5970fc135" candidate_uuid: "dcea812991434689a018cb053b23d702" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5c0eebd829645b786dac238875068e5" is_pre_election: true
I20260812 11:10:06.071921 5858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e891e67793fd41ec8b69dbe5970fc135" candidate_uuid: "dcea812991434689a018cb053b23d702" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb450c77f4f4d339a6c47ac86db00ca" is_pre_election: true
I20260812 11:10:06.072451 5619 raft_consensus.cc:2454] T e891e67793fd41ec8b69dbe5970fc135 P e5c0eebd829645b786dac238875068e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcea812991434689a018cb053b23d702 in term 0.
I20260812 11:10:06.072523 5858 raft_consensus.cc:2454] T e891e67793fd41ec8b69dbe5970fc135 P 2fb450c77f4f4d339a6c47ac86db00ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dcea812991434689a018cb053b23d702 in term 0.
I20260812 11:10:06.073426 5295 leader_election.cc:302] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fb450c77f4f4d339a6c47ac86db00ca, dcea812991434689a018cb053b23d702; no voters:
I20260812 11:10:06.073853 5972 raft_consensus.cc:2781] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:06.074019 5972 raft_consensus.cc:482] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:06.074133 5972 raft_consensus.cc:3037] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:06.076442 5972 raft_consensus.cc:504] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb450c77f4f4d339a6c47ac86db00ca" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33331 } } peers { permanent_uuid: "e5c0eebd829645b786dac238875068e5" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40703 } } peers { permanent_uuid: "dcea812991434689a018cb053b23d702" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40813 } }
I20260812 11:10:06.077133 5972 leader_election.cc:288] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [CANDIDATE]: Term 1 election: Requested vote from peers 2fb450c77f4f4d339a6c47ac86db00ca (127.4.26.67:33331), e5c0eebd829645b786dac238875068e5 (127.4.26.66:40703)
I20260812 11:10:06.077721 5858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e891e67793fd41ec8b69dbe5970fc135" candidate_uuid: "dcea812991434689a018cb053b23d702" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fb450c77f4f4d339a6c47ac86db00ca"
I20260812 11:10:06.077757 5619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e891e67793fd41ec8b69dbe5970fc135" candidate_uuid: "dcea812991434689a018cb053b23d702" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5c0eebd829645b786dac238875068e5"
I20260812 11:10:06.077957 5858 raft_consensus.cc:3037] T e891e67793fd41ec8b69dbe5970fc135 P 2fb450c77f4f4d339a6c47ac86db00ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:06.077960 5619 raft_consensus.cc:3037] T e891e67793fd41ec8b69dbe5970fc135 P e5c0eebd829645b786dac238875068e5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:06.080395 5619 raft_consensus.cc:2454] T e891e67793fd41ec8b69dbe5970fc135 P e5c0eebd829645b786dac238875068e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea812991434689a018cb053b23d702 in term 1.
I20260812 11:10:06.080744 5858 raft_consensus.cc:2454] T e891e67793fd41ec8b69dbe5970fc135 P 2fb450c77f4f4d339a6c47ac86db00ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dcea812991434689a018cb053b23d702 in term 1.
I20260812 11:10:06.080921 5297 leader_election.cc:302] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dcea812991434689a018cb053b23d702, e5c0eebd829645b786dac238875068e5; no voters:
I20260812 11:10:06.081271 5972 raft_consensus.cc:2781] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:06.081823 5972 raft_consensus.cc:686] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [term 1 LEADER]: Becoming Leader. State: Replica: dcea812991434689a018cb053b23d702, State: Running, Role: LEADER
I20260812 11:10:06.082379 5972 consensus_queue.cc:237] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb450c77f4f4d339a6c47ac86db00ca" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33331 } } peers { permanent_uuid: "e5c0eebd829645b786dac238875068e5" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40703 } } peers { permanent_uuid: "dcea812991434689a018cb053b23d702" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40813 } }
I20260812 11:10:06.088897 5180 catalog_manager.cc:5495] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702 reported cstate change: term changed from 0 to 1, leader changed from <none> to dcea812991434689a018cb053b23d702 (127.4.26.65). New cstate: current_term: 1 leader_uuid: "dcea812991434689a018cb053b23d702" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fb450c77f4f4d339a6c47ac86db00ca" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5c0eebd829645b786dac238875068e5" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dcea812991434689a018cb053b23d702" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40813 } health_report { overall_health: HEALTHY } } }
Aug 12 11:10:06 dist-test-slave-rmhg krb5kdc[5101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533003, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:10:06.153046 5960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:06.137216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49626 (local address 127.4.26.65:40813)
0812 11:10:06.137459 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:06.137466 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:06.137972 (+ 506us) server_negotiation.cc:407] Connection header received
0812 11:10:06.138099 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:06.138103 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:06.138172 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:06.138262 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:06.139900 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.140731 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.142192 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.142670 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.142778 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:06.147001 (+ 4223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:06.147019 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:06.147039 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:06.147090 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:06.150199 (+ 3109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:06.151001 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:06.151011 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:06.151014 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:06.151228 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:06.151557 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:06.151560 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:06.151562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:06.151948 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:06.152180 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:06.152521 (+ 341us) server_negotiation.cc:299] Negotiation successful
0812 11:10:06.152777 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
Aug 12 11:10:06 dist-test-slave-rmhg krb5kdc[5101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533006, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260812 11:10:06.189556 5476 tablet.cc:2369] T e891e67793fd41ec8b69dbe5970fc135 P dcea812991434689a018cb053b23d702: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 11:10:06 dist-test-slave-rmhg krb5kdc[5101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533006, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:10:06.207436 5960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:06.191697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49634 (local address 127.4.26.65:40813)
0812 11:10:06.191903 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:06.191910 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:06.192338 (+ 428us) server_negotiation.cc:407] Connection header received
0812 11:10:06.192582 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:06.192586 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:06.192661 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:06.192753 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:06.194282 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.195054 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.196457 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.196931 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.197092 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:06.201419 (+ 4327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:06.201425 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:06.201429 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:06.201475 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:06.204404 (+ 2929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:06.205244 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:06.205252 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:06.205255 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:06.205430 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:06.205913 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:06.205918 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:06.205920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:06.206219 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:06.206541 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:06.206803 (+ 262us) server_negotiation.cc:299] Negotiation successful
0812 11:10:06.207065 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Aug 12 11:10:06 dist-test-slave-rmhg krb5kdc[5101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:10:06 dist-test-slave-rmhg krb5kdc[5101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:10:06.266937 5960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:06.250394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49642 (local address 127.4.26.65:40813)
0812 11:10:06.250563 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:06.250570 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:06.251091 (+ 521us) server_negotiation.cc:407] Connection header received
0812 11:10:06.251287 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:06.251292 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:06.251382 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:06.251474 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:06.253045 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.253988 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.255432 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.255896 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.256183 (+ 287us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:06.260843 (+ 4660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:06.260849 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:06.260852 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:06.260899 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:06.263932 (+ 3033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:06.264798 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:06.264803 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:06.264806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:06.264974 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:06.265431 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:06.265435 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:06.265437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:06.265746 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:06.266006 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:06.266316 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 11:10:06.266568 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260812 11:10:06.269481 5340 tablet_service.cc:2908] Rejecting scan request for tablet e891e67793fd41ec8b69dbe5970fc135: Uninitialized: clean time has not yet been initialized
I20260812 11:10:06.273505 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 5271
I20260812 11:10:06.289995 5960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:06.274790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49652 (local address 127.4.26.65:40813)
0812 11:10:06.274952 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:06.274957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:06.275375 (+ 418us) server_negotiation.cc:407] Connection header received
0812 11:10:06.275526 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:06.275529 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:06.275626 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:06.275717 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:06.277098 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.277927 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.279317 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.279796 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.279912 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:06.282974 (+ 3062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:06.282980 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:06.282984 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:06.283036 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:06.286186 (+ 3150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:06.287475 (+ 1289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:06.287483 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:06.287486 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:06.287715 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:06.288338 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:06.288344 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:06.288348 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:06.288724 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:06.288935 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:06.289396 (+ 461us) server_negotiation.cc:299] Negotiation successful
0812 11:10:06.289679 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:10:06.290657 5466 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:06.386618 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 5271
I20260812 11:10:06.411331 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 5482
Aug 12 11:10:06 dist-test-slave-rmhg krb5kdc[5101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:10:06.427572 5961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:06.412299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36166 (local address 127.4.26.66:40703)
0812 11:10:06.412529 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:06.412533 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:06.412552 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:10:06.412609 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:06.412613 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:06.412677 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:06.412760 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:06.414104 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.414910 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.416277 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.416711 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.416813 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:06.421145 (+ 4332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:06.421206 (+ 61us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:06.421230 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:06.421282 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:06.424409 (+ 3127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:06.425378 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:06.425389 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:06.425391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:06.425554 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:06.425922 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:06.425925 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:06.425927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:06.426346 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:06.426653 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:06.427008 (+ 355us) server_negotiation.cc:299] Negotiation successful
0812 11:10:06.427230 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 11:10:06.428431 5688 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:06.518896 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 5482
I20260812 11:10:06.540980 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 5707
Aug 12 11:10:06 dist-test-slave-rmhg krb5kdc[5101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:10:06.556743 5955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:06.541910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34662 (local address 127.4.26.67:33331)
0812 11:10:06.542079 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:06.542084 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:06.542104 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:10:06.542325 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:06.542330 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:06.542404 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:06.542499 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:06.543753 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.544491 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.545954 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:06.546395 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:06.546513 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:06.550919 (+ 4406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:06.550941 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:06.550959 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:06.551009 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:06.553888 (+ 2879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:06.554722 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:06.554732 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:06.554735 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:06.554901 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:06.555347 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:06.555350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:06.555352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:06.555747 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:06.555976 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:06.556267 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 11:10:06.556459 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 11:10:06.557520 5918 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:06.648072 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 5707
I20260812 11:10:06.673121 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 5124
I20260812 11:10:06.674448 5228 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:06.785436 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 5124
2026-08-12T11:10:06Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4658 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:06 dist-test-slave-rmhg krb5kdc[6003](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:06 dist-test-slave-rmhg krb5kdc[6003](info): set up 2 sockets
Aug 12 11:10:06 dist-test-slave-rmhg krb5kdc[6003](info): commencing operation
krb5kdc: starting...
W20260812 11:10:08.023962 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.005s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:10:08 dist-test-slave-rmhg krb5kdc[6003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:10:08.229759 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:39515
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:38079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:39515
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:08.577875 6023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:08.578250 6023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:08.578393 6023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:08.586230 6023 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:08.586386 6023 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 11:10:08.586458 6023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:08.586552 6023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:08.586622 6023 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:08.586709 6023 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:08.597317 6023 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:38079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:39515
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:39515
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:08.598722 6023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:08.600191 6023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:08.612787 6030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:08.612843 6031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:08.612816 6034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:08.613626 6023 server_base.cc:1034] running on GCE node
I20260812 11:10:08.614548 6023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:08.616108 6023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:08.617372 6023 hybrid_clock.cc:648] HybridClock initialized: now 1786533008617285 us; error 62 us; skew 500 ppm
I20260812 11:10:08.617784 6023 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:08 dist-test-slave-rmhg krb5kdc[6003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533008, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:08.621492 6023 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:10:08.623231 6023 webserver.cc:460] Webserver started at http://127.4.26.126:41251/ using document root <none> and password file <none>
I20260812 11:10:08.624022 6023 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:08.624145 6023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:08.624500 6023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:08.627835 6023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "de632b6fef67497e956394cb321dacac"
format_stamp: "Formatted at 2026-08-12 11:10:08 on dist-test-slave-rmhg"
server_key: "cba0f56ad593709e5ce34adfe1272472"
server_key_iv: "3e678ccfe8f46762a9d23e0ab41a1279"
server_key_version: "encryptionkey@0"
I20260812 11:10:08.628702 6023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "de632b6fef67497e956394cb321dacac"
format_stamp: "Formatted at 2026-08-12 11:10:08 on dist-test-slave-rmhg"
server_key: "cba0f56ad593709e5ce34adfe1272472"
server_key_iv: "3e678ccfe8f46762a9d23e0ab41a1279"
server_key_version: "encryptionkey@0"
I20260812 11:10:08.634395 6023 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 11:10:08.638444 6051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:08.640018 6023 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260812 11:10:08.640200 6023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "de632b6fef67497e956394cb321dacac"
format_stamp: "Formatted at 2026-08-12 11:10:08 on dist-test-slave-rmhg"
server_key: "cba0f56ad593709e5ce34adfe1272472"
server_key_iv: "3e678ccfe8f46762a9d23e0ab41a1279"
server_key_version: "encryptionkey@0"
I20260812 11:10:08.640429 6023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:08.674821 6023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:08.679878 6023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:08.680181 6023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:08.701824 6023 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:39515
I20260812 11:10:08.701830 6140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:39515 every 8 connection(s)
I20260812 11:10:08.703270 6023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:08.707319 6141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:08.711249 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 6023
I20260812 11:10:08.711462 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:10:08.712162 4201 external_mini_cluster.cc:1428] Setting key e18adf40ffb95ab476c960f5cb0d0e58
I20260812 11:10:08.719172 6141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac: Bootstrap starting.
I20260812 11:10:08.723119 6141 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:08.724356 6141 log.cc:824] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:10:08 dist-test-slave-rmhg krb5kdc[6003](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:08.728085 6141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac: No bootstrap required, opened a new log
I20260812 11:10:08.736456 6141 raft_consensus.cc:348] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de632b6fef67497e956394cb321dacac" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 39515 } }
I20260812 11:10:08.736899 6141 raft_consensus.cc:374] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:08.736946 6145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:08.714535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49736 (local address 127.4.26.126:39515)
0812 11:10:08.715344 (+ 809us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:08.715357 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:08.715405 (+ 48us) server_negotiation.cc:407] Connection header received
0812 11:10:08.717442 (+ 2037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:08.717469 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:08.717911 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:08.718261 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:08.720160 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:08.721650 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:08.723406 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:08.724166 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:08.724302 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:08.728953 (+ 4651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:08.728963 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:08.728986 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:08.729026 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:08.732392 (+ 3366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:08.733264 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:08.733272 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:08.733280 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:08.733492 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:08.733920 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:08.733924 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:08.733927 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:08.734558 (+ 631us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:08.734871 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:08.735364 (+ 493us) server_negotiation.cc:299] Negotiation successful
0812 11:10:08.735851 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":346,"threads_started":1}
I20260812 11:10:08.737025 6141 raft_consensus.cc:729] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de632b6fef67497e956394cb321dacac, State: Initialized, Role: FOLLOWER
I20260812 11:10:08.737726 6141 consensus_queue.cc:260] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de632b6fef67497e956394cb321dacac" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 39515 } }
I20260812 11:10:08.737989 6141 raft_consensus.cc:388] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:08.738148 6141 raft_consensus.cc:482] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:08.738343 6141 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:08.741120 6141 raft_consensus.cc:504] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de632b6fef67497e956394cb321dacac" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 39515 } }
I20260812 11:10:08.741662 6141 leader_election.cc:302] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de632b6fef67497e956394cb321dacac; no voters:
I20260812 11:10:08.742244 6141 leader_election.cc:288] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:08.742391 6149 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:08.743147 6149 raft_consensus.cc:686] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [term 1 LEADER]: Becoming Leader. State: Replica: de632b6fef67497e956394cb321dacac, State: Running, Role: LEADER
I20260812 11:10:08.743794 6149 consensus_queue.cc:237] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de632b6fef67497e956394cb321dacac" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 39515 } }
I20260812 11:10:08.744467 6141 sys_catalog.cc:564] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:08.747260 6152 sys_catalog.cc:455] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [sys.catalog]: SysCatalogTable state changed. Reason: New leader de632b6fef67497e956394cb321dacac. Latest consensus state: current_term: 1 leader_uuid: "de632b6fef67497e956394cb321dacac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de632b6fef67497e956394cb321dacac" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 39515 } } }
I20260812 11:10:08.747265 6150 sys_catalog.cc:455] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de632b6fef67497e956394cb321dacac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de632b6fef67497e956394cb321dacac" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 39515 } } }
I20260812 11:10:08.747792 6150 sys_catalog.cc:458] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:08.747792 6152 sys_catalog.cc:458] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:08.753957 6158 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:08.758742 6158 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:08.768472 6158 catalog_manager.cc:1347] Generated new cluster ID: f3c221261e7b42d687f2b2e9ed85f8c6
I20260812 11:10:08.768613 6158 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:08.785133 6158 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:08.786636 6158 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:08.793784 6158 catalog_manager.cc:5868] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac: Generated new TSK 0
I20260812 11:10:08.795064 6158 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:10:08.853580 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:39515
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:38079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:09.206915 6180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:09.207237 6180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:09.207366 6180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:09.214975 6180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:09.215140 6180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:09.215248 6180 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:10:09.215368 6180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:10:09.225821 6180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:38079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.26.126:39515
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:09.227295 6180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:09.228758 6180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:09.242996 6188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:09.243044 6189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:09.243075 6192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:09.243752 6180 server_base.cc:1034] running on GCE node
I20260812 11:10:09.244611 6180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:09.245780 6180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:09.247063 6180 hybrid_clock.cc:648] HybridClock initialized: now 1786533009246974 us; error 62 us; skew 500 ppm
I20260812 11:10:09.247418 6180 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:09 dist-test-slave-rmhg krb5kdc[6003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533009, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:09.251497 6180 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:10:09.253682 6180 webserver.cc:460] Webserver started at http://127.4.26.65:46383/ using document root <none> and password file <none>
I20260812 11:10:09.254483 6180 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:09.254601 6180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:09.254959 6180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:09.258194 6180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "47f7254e3eac48d8839cae24bf83c629"
format_stamp: "Formatted at 2026-08-12 11:10:09 on dist-test-slave-rmhg"
server_key: "8fcfc922cd0ef4794e9536edf37f25ce"
server_key_iv: "4a5207461eb2e9e567257a67209c0cf9"
server_key_version: "encryptionkey@0"
I20260812 11:10:09.259045 6180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "47f7254e3eac48d8839cae24bf83c629"
format_stamp: "Formatted at 2026-08-12 11:10:09 on dist-test-slave-rmhg"
server_key: "8fcfc922cd0ef4794e9536edf37f25ce"
server_key_iv: "4a5207461eb2e9e567257a67209c0cf9"
server_key_version: "encryptionkey@0"
I20260812 11:10:09.264719 6180 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260812 11:10:09.268533 6201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:09.270064 6180 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:09.270233 6180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "47f7254e3eac48d8839cae24bf83c629"
format_stamp: "Formatted at 2026-08-12 11:10:09 on dist-test-slave-rmhg"
server_key: "8fcfc922cd0ef4794e9536edf37f25ce"
server_key_iv: "4a5207461eb2e9e567257a67209c0cf9"
server_key_version: "encryptionkey@0"
I20260812 11:10:09.270454 6180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:09.295632 6180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:09.300529 6180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:09.300827 6180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:09.303944 6180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:09.304069 6180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:09.304206 6180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:09.304272 6180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:10:09 dist-test-slave-rmhg krb5kdc[6003](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533009, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:09.330374 6217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:09.306255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:46051 (local address 127.4.26.126:39515)
0812 11:10:09.309619 (+ 3364us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:09.309626 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:09.309652 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:10:09.309728 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:09.309733 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:09.309834 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:09.311182 (+ 1348us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:09.312657 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:09.313874 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:09.316541 (+ 2667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:09.317114 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:09.317291 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:09.322708 (+ 5417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:09.322714 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:09.322718 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:09.322759 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:09.326058 (+ 3299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:09.327279 (+ 1221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:09.327284 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:09.327287 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:09.327430 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:09.328128 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:09.328133 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:09.328137 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:09.328479 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:09.328618 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:09.329647 (+ 1029us) server_negotiation.cc:299] Negotiation successful
0812 11:10:09.329951 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3219,"thread_start_us":3096,"threads_started":1}
I20260812 11:10:09.331349 6216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:09.305638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:39515 (local address 127.4.26.65:46051)
0812 11:10:09.306551 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:09.306600 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:09.308513 (+ 1913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:09.310355 (+ 1842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:09.310365 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:09.311261 (+ 896us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:09.312357 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:09.312392 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:09.314071 (+ 1679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:09.314080 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:09.316279 (+ 2199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:09.316306 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:09.317414 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:09.317422 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:09.317793 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:09.318763 (+ 970us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:09.318797 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:09.322311 (+ 3514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:09.326263 (+ 3952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:09.326273 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:09.326293 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:09.327061 (+ 768us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:09.327601 (+ 540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:09.327606 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:09.327614 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:09.327987 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:09.328641 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:09.328651 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:09.329052 (+ 401us) client_negotiation.cc:769] Sending connection context
0812 11:10:09.329425 (+ 373us) client_negotiation.cc:240] Negotiation successful
0812 11:10:09.329931 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":367,"threads_started":1}
I20260812 11:10:09.352649 6180 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:41449
I20260812 11:10:09.352687 6395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:41449 every 8 connection(s)
I20260812 11:10:09.354166 6180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:09.355674 6370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:09.339777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:39515 (local address 127.4.26.65:39825)
0812 11:10:09.340499 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:09.340523 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:09.340704 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:09.341109 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:09.341114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:09.341822 (+ 708us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:09.342245 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:09.342261 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:09.343392 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:09.343398 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:09.345363 (+ 1965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:09.345387 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:09.346381 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:09.346389 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:09.346554 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:09.347445 (+ 891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:09.347465 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:09.348643 (+ 1178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:09.352323 (+ 3680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:09.352328 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:09.352337 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:09.352976 (+ 639us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:09.353626 (+ 650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:09.353631 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:09.353645 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:09.353794 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:09.354410 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:09.354415 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:09.354638 (+ 223us) client_negotiation.cc:769] Sending connection context
0812 11:10:09.354783 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 11:10:09.355163 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":370,"threads_started":1}
I20260812 11:10:09.355839 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 6180
I20260812 11:10:09.356086 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:09.356889 4201 external_mini_cluster.cc:1428] Setting key a5e5e308e724de5364bf1cc7d9550fe4
I20260812 11:10:09.356868 6396 heartbeater.cc:347] Connected to a master server at 127.4.26.126:39515
I20260812 11:10:09.357183 6396 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:09.357420 6217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:09.339817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:39825 (local address 127.4.26.126:39515)
0812 11:10:09.340045 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:09.340053 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:09.340628 (+ 575us) server_negotiation.cc:407] Connection header received
0812 11:10:09.340870 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:09.340876 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:09.340963 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:09.341064 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:09.342446 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:09.343249 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:09.345562 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:09.346094 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:09.346279 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:09.348909 (+ 2630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:09.348915 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:09.348918 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:09.348956 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:09.352155 (+ 3199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:09.353128 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:09.353134 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:09.353138 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:09.353470 (+ 332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:09.353926 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:09.353931 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:09.353933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:09.354286 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:09.354452 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:09.354911 (+ 459us) server_negotiation.cc:299] Negotiation successful
0812 11:10:09.355159 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 11:10:09.358099 6396 heartbeater.cc:511] Master 127.4.26.126:39515 requested a full tablet report, sending...
I20260812 11:10:09.360589 6075 ts_manager.cc:194] Registered new tserver with Master: 47f7254e3eac48d8839cae24bf83c629 (127.4.26.65:41449)
I20260812 11:10:09.362636 6075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:46051
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:10:09.404713 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:39515
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:38079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:09.747601 6407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:09.747920 6407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:09.748066 6407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:09.755553 6407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:09.755707 6407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:09.755838 6407 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:10:09.755952 6407 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:10:09.766516 6407 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:38079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.26.126:39515
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:09.767971 6407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:09.769477 6407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:09.783908 6420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:09.783880 6417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:09.783936 6422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:09.784914 6407 server_base.cc:1034] running on GCE node
I20260812 11:10:09.785727 6407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:09.786792 6407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:09.788065 6407 hybrid_clock.cc:648] HybridClock initialized: now 1786533009787991 us; error 36 us; skew 500 ppm
I20260812 11:10:09.788410 6407 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:09 dist-test-slave-rmhg krb5kdc[6003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533009, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:09.796046 6407 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:10:09.798012 6407 webserver.cc:460] Webserver started at http://127.4.26.66:38397/ using document root <none> and password file <none>
I20260812 11:10:09.798853 6407 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:09.798966 6407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:09.799332 6407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:09.802704 6407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "6369a58e5805459fb64c27385e543627"
format_stamp: "Formatted at 2026-08-12 11:10:09 on dist-test-slave-rmhg"
server_key: "5efcc1af249e1ea372fca84509c12f60"
server_key_iv: "8b19b14da3fd476f3c54efca8547256c"
server_key_version: "encryptionkey@0"
I20260812 11:10:09.803601 6407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "6369a58e5805459fb64c27385e543627"
format_stamp: "Formatted at 2026-08-12 11:10:09 on dist-test-slave-rmhg"
server_key: "5efcc1af249e1ea372fca84509c12f60"
server_key_iv: "8b19b14da3fd476f3c54efca8547256c"
server_key_version: "encryptionkey@0"
I20260812 11:10:09.809621 6407 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260812 11:10:09.813791 6437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:09.815408 6407 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:10:09.815624 6407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "6369a58e5805459fb64c27385e543627"
format_stamp: "Formatted at 2026-08-12 11:10:09 on dist-test-slave-rmhg"
server_key: "5efcc1af249e1ea372fca84509c12f60"
server_key_iv: "8b19b14da3fd476f3c54efca8547256c"
server_key_version: "encryptionkey@0"
I20260812 11:10:09.815858 6407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:09.830226 6407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:09.835160 6407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:09.835443 6407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:09.838519 6407 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:09.838629 6407 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:09.838761 6407 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:09.838824 6407 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:10:09 dist-test-slave-rmhg krb5kdc[6003](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533009, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:09.865983 6217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:09.839267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:56149 (local address 127.4.26.126:39515)
0812 11:10:09.839511 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:09.839519 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:09.841411 (+ 1892us) server_negotiation.cc:407] Connection header received
0812 11:10:09.844601 (+ 3190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:09.844611 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:09.844725 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:09.844801 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:09.848107 (+ 3306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:09.849203 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:09.851329 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:09.851794 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:09.851926 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:09.857224 (+ 5298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:09.857232 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:09.857236 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:09.857290 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:09.860938 (+ 3648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:09.862783 (+ 1845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:09.862791 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:09.862795 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:09.863006 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:09.863731 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:09.863739 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:09.863742 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:09.864193 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:09.864365 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:09.865325 (+ 960us) server_negotiation.cc:299] Negotiation successful
0812 11:10:09.865619 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:10:09.867329 6453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:09.840204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:39515 (local address 127.4.26.66:56149)
0812 11:10:09.841183 (+ 979us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:09.841256 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:09.844089 (+ 2833us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:09.845498 (+ 1409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:09.845511 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:09.846564 (+ 1053us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:09.847790 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:09.847828 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:09.849490 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:09.849497 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:09.851141 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:09.851157 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:09.852081 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:09.852090 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:09.852332 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:09.853193 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:09.853232 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:09.856839 (+ 3607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:09.861235 (+ 4396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:09.861251 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:09.861278 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:09.862479 (+ 1201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:09.863155 (+ 676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:09.863161 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:09.863166 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:09.863574 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:09.864360 (+ 786us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:09.864371 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:09.864839 (+ 468us) client_negotiation.cc:769] Sending connection context
0812 11:10:09.865127 (+ 288us) client_negotiation.cc:240] Negotiation successful
0812 11:10:09.865880 (+ 753us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":341,"threads_started":1}
I20260812 11:10:09.894596 6217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:09.876688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:43467 (local address 127.4.26.126:39515)
0812 11:10:09.876953 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:09.876961 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:09.877617 (+ 656us) server_negotiation.cc:407] Connection header received
0812 11:10:09.877884 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:09.877890 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:09.877990 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:09.878125 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:09.879848 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:09.880855 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:09.883539 (+ 2684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:09.884022 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:09.884140 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:09.887117 (+ 2977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:09.887125 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:09.887130 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:09.887172 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:09.890452 (+ 3280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:09.891710 (+ 1258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:09.891716 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:09.891720 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:09.891954 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:09.892596 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:09.892601 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:09.892604 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:09.893212 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:09.893400 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:09.893996 (+ 596us) server_negotiation.cc:299] Negotiation successful
0812 11:10:09.894250 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 11:10:09.894722 6407 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:34957
I20260812 11:10:09.894860 6576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:09.876590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:39515 (local address 127.4.26.66:43467)
0812 11:10:09.877468 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:09.877491 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:09.877702 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:09.878166 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:09.878171 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:09.879007 (+ 836us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:09.879551 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:09.879572 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:09.881064 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:09.881074 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:09.883322 (+ 2248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:09.883347 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:09.884254 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:09.884262 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:09.884483 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:09.885322 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:09.885355 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:09.886821 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:09.890645 (+ 3824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:09.890654 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:09.890658 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:09.891471 (+ 813us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:09.892114 (+ 643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:09.892120 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:09.892124 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:09.892430 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:09.893416 (+ 986us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:09.893422 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:09.893668 (+ 246us) client_negotiation.cc:769] Sending connection context
0812 11:10:09.893868 (+ 200us) client_negotiation.cc:240] Negotiation successful
0812 11:10:09.894370 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"thread_start_us":410,"threads_started":1}
I20260812 11:10:09.895738 6652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:34957 every 8 connection(s)
I20260812 11:10:09.896600 6407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:09.896899 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 6407
I20260812 11:10:09.897292 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:09.897882 4201 external_mini_cluster.cc:1428] Setting key 74d6eb850eb4348958d6826f23eb054a
I20260812 11:10:09.900162 6653 heartbeater.cc:347] Connected to a master server at 127.4.26.126:39515
I20260812 11:10:09.900466 6653 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:09.901506 6653 heartbeater.cc:511] Master 127.4.26.126:39515 requested a full tablet report, sending...
I20260812 11:10:09.903818 6078 ts_manager.cc:194] Registered new tserver with Master: 6369a58e5805459fb64c27385e543627 (127.4.26.66:34957)
I20260812 11:10:09.905016 6078 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:56149
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:10:09.948626 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:39515
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:38079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:10.300203 6658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:10.300527 6658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:10.300660 6658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:10.308804 6658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:10.308943 6658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:10.309060 6658 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:10:10.309196 6658 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:10:10.319890 6658 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:38079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.26.126:39515
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:10.321455 6658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:10.322943 6658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:10.337423 6663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:10.337445 6665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:10.337476 6667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:10.338295 6658 server_base.cc:1034] running on GCE node
I20260812 11:10:10.339002 6658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:10.340055 6658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:10.341320 6658 hybrid_clock.cc:648] HybridClock initialized: now 1786533010341245 us; error 44 us; skew 500 ppm
I20260812 11:10:10.341682 6658 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:10 dist-test-slave-rmhg krb5kdc[6003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533010, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:10.345263 6658 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:10:10.347002 6658 webserver.cc:460] Webserver started at http://127.4.26.67:40407/ using document root <none> and password file <none>
I20260812 11:10:10.347738 6658 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:10.347837 6658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:10.348147 6658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:10.351492 6658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "a1db5d0cb36f4a28a37d42cba1786d38"
format_stamp: "Formatted at 2026-08-12 11:10:10 on dist-test-slave-rmhg"
server_key: "8349bbe0858a7798b58cf74c46920339"
server_key_iv: "cf2f143d132342446c3544c36b1597cf"
server_key_version: "encryptionkey@0"
I20260812 11:10:10.352389 6658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "a1db5d0cb36f4a28a37d42cba1786d38"
format_stamp: "Formatted at 2026-08-12 11:10:10 on dist-test-slave-rmhg"
server_key: "8349bbe0858a7798b58cf74c46920339"
server_key_iv: "cf2f143d132342446c3544c36b1597cf"
server_key_version: "encryptionkey@0"
I20260812 11:10:10.358225 6658 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 11:10:10.362746 6685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:10.364580 6658 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:10:10.364794 6658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "a1db5d0cb36f4a28a37d42cba1786d38"
format_stamp: "Formatted at 2026-08-12 11:10:10 on dist-test-slave-rmhg"
server_key: "8349bbe0858a7798b58cf74c46920339"
server_key_iv: "cf2f143d132342446c3544c36b1597cf"
server_key_version: "encryptionkey@0"
I20260812 11:10:10.365042 6658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:10.366142 6396 heartbeater.cc:503] Master 127.4.26.126:39515 was elected leader, sending a full tablet report...
I20260812 11:10:10.382400 6658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:10.387487 6658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:10.387827 6658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:10.390965 6658 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:10.391074 6658 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:10.391239 6658 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:10.391314 6658 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:10:10 dist-test-slave-rmhg krb5kdc[6003](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533010, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:10.416798 6217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.391463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:57853 (local address 127.4.26.126:39515)
0812 11:10:10.391713 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:10.391721 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:10.393251 (+ 1530us) server_negotiation.cc:407] Connection header received
0812 11:10:10.395566 (+ 2315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:10.395573 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:10.395700 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:10.395834 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:10.398575 (+ 2741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.399867 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.402585 (+ 2718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.403111 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.403253 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:10.408242 (+ 4989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:10.408251 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:10.408256 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:10.408311 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:10.412352 (+ 4041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:10.413401 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:10.413407 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:10.413409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:10.413576 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:10.414333 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:10.414340 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:10.414344 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:10.414792 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:10.414983 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:10.416278 (+ 1295us) server_negotiation.cc:299] Negotiation successful
0812 11:10:10.416534 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 11:10:10.418906 6701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.391999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:39515 (local address 127.4.26.67:57853)
0812 11:10:10.393019 (+ 1020us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:10.393074 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:10.395158 (+ 2084us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:10.396240 (+ 1082us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:10.396253 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:10.397145 (+ 892us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:10.398237 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:10.398276 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.400116 (+ 1840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.400122 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:10.402358 (+ 2236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:10.402379 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.403416 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.403425 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:10.403671 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:10.404402 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:10.404428 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:10.407829 (+ 3401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:10.412606 (+ 4777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:10.412618 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:10.412636 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:10.413234 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:10.413715 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:10.413723 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:10.413727 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:10.414082 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:10.414983 (+ 901us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:10.414999 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:10.415653 (+ 654us) client_negotiation.cc:769] Sending connection context
0812 11:10:10.416088 (+ 435us) client_negotiation.cc:240] Negotiation successful
0812 11:10:10.416804 (+ 716us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"thread_start_us":373,"threads_started":1}
I20260812 11:10:10.444252 6217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.428661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:45645 (local address 127.4.26.126:39515)
0812 11:10:10.428909 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:10.428917 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:10.429541 (+ 624us) server_negotiation.cc:407] Connection header received
0812 11:10:10.429791 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:10.429797 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:10.429890 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:10.430001 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:10.431393 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.432159 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.434331 (+ 2172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.434857 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.434962 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:10.437545 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:10.437551 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:10.437554 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:10.437592 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:10.441104 (+ 3512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:10.442137 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:10.442143 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:10.442146 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:10.442294 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:10.442663 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:10.442667 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:10.442669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:10.442974 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:10.443113 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:10.443544 (+ 431us) server_negotiation.cc:299] Negotiation successful
0812 11:10:10.443788 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:10:10.444284 6836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.428548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:39515 (local address 127.4.26.67:45645)
0812 11:10:10.429401 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:10.429427 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:10.429650 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:10.430073 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:10.430083 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:10.430757 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:10.431187 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:10.431203 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.432319 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.432325 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:10.434133 (+ 1808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:10.434162 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.435076 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.435084 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:10.435287 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:10.436054 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:10.436078 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:10.437289 (+ 1211us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:10.441324 (+ 4035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:10.441330 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:10.441334 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:10.441935 (+ 601us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:10.442407 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:10.442412 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:10.442417 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:10.442549 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:10.443091 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:10.443097 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:10.443276 (+ 179us) client_negotiation.cc:769] Sending connection context
0812 11:10:10.443394 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 11:10:10.443788 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":378,"threads_started":1}
I20260812 11:10:10.452368 6658 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:34751
I20260812 11:10:10.452397 6895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:34751 every 8 connection(s)
I20260812 11:10:10.453761 6658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:10.455940 6896 heartbeater.cc:347] Connected to a master server at 127.4.26.126:39515
I20260812 11:10:10.456221 6896 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:10.456961 6896 heartbeater.cc:511] Master 127.4.26.126:39515 requested a full tablet report, sending...
I20260812 11:10:10.458683 6078 ts_manager.cc:194] Registered new tserver with Master: a1db5d0cb36f4a28a37d42cba1786d38 (127.4.26.67:34751)
I20260812 11:10:10.459561 6078 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:57853
I20260812 11:10:10.461231 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 6658
I20260812 11:10:10.461447 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:10.461985 4201 external_mini_cluster.cc:1428] Setting key a96391caafa05db29fa6dd666cb82913
I20260812 11:10:10.465940 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:10:10 dist-test-slave-rmhg krb5kdc[6003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533010, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:10:10 dist-test-slave-rmhg krb5kdc[6003](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533010, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:10.519304 6217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.503245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34698 (local address 127.4.26.126:39515)
0812 11:10:10.503417 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:10.503422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:10.503704 (+ 282us) server_negotiation.cc:407] Connection header received
0812 11:10:10.503828 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:10.503832 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:10.503903 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:10.504002 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:10.505853 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.506671 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.508014 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.508456 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.508638 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:10.512907 (+ 4269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:10.512913 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:10.512923 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:10.512974 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:10.516130 (+ 3156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:10.517042 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:10.517047 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:10.517050 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:10.517273 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:10.517753 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:10.517757 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:10.517759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:10.518103 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:10.518311 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:10.518723 (+ 412us) server_negotiation.cc:299] Negotiation successful
0812 11:10:10.518948 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:10:10.524722 6078 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34698:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:10:10.531958 6078 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:10.568164 6915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.545939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45206 (local address 127.4.26.65:41449)
0812 11:10:10.558263 (+ 12324us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:10.558273 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:10.558313 (+ 40us) server_negotiation.cc:407] Connection header received
0812 11:10:10.558437 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:10.558445 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:10.558739 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:10.558976 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:10.559868 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.561536 (+ 1668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.564770 (+ 3234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.566373 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.566812 (+ 439us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:10.567078 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:10.567643 (+ 565us) server_negotiation.cc:299] Negotiation successful
0812 11:10:10.567853 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12129,"thread_start_us":13211,"threads_started":1}
I20260812 11:10:10.568378 6917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.545730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:41449 (local address 127.0.0.1:45206)
0812 11:10:10.557374 (+ 11644us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:10.557455 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:10.557717 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:10.559036 (+ 1319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:10.559045 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:10.559116 (+ 71us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:10.559626 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:10.559642 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.561747 (+ 2105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.561754 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:10.564563 (+ 2809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:10.564580 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.566627 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.566634 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:10.567343 (+ 709us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:10.567418 (+ 75us) client_negotiation.cc:769] Sending connection context
0812 11:10:10.567565 (+ 147us) client_negotiation.cc:240] Negotiation successful
0812 11:10:10.567778 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11227,"mutex_wait_us":402,"thread_start_us":14102,"threads_started":1}
I20260812 11:10:10.570432 6914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.546119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:34957 (local address 127.0.0.1:58606)
0812 11:10:10.560134 (+ 14015us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:10.560151 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:10.560246 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:10.562726 (+ 2480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:10.562731 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:10.562755 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:10.563257 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:10.563272 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.565147 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.565180 (+ 33us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:10.567260 (+ 2080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:10.567272 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.569114 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.569191 (+ 77us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:10.569369 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:10.569406 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:10:10.569497 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 11:10:10.569804 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13888,"mutex_wait_us":63,"thread_start_us":15954,"threads_started":1}
I20260812 11:10:10.571072 6916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.546293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:34751 (local address 127.0.0.1:51226)
0812 11:10:10.562383 (+ 16090us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:10.562403 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:10.562555 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:10.563455 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:10.563460 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:10.563488 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:10.563856 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:10.563865 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.565696 (+ 1831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.565701 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:10.567833 (+ 2132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:10.567847 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.570173 (+ 2326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.570180 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:10.570408 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:10.570507 (+ 99us) client_negotiation.cc:769] Sending connection context
0812 11:10:10.570613 (+ 106us) client_negotiation.cc:240] Negotiation successful
0812 11:10:10.570758 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15957,"thread_start_us":11693,"threads_started":1}
I20260812 11:10:10.571811 6919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.547545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51226 (local address 127.4.26.67:34751)
0812 11:10:10.560756 (+ 13211us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:10.560764 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:10.562556 (+ 1792us) server_negotiation.cc:407] Connection header received
0812 11:10:10.562723 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:10.562731 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:10.563008 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:10.563223 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:10.564060 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.565501 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.568056 (+ 2555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.569502 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.569731 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:10.570004 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:10.571384 (+ 1380us) server_negotiation.cc:299] Negotiation successful
0812 11:10:10.571557 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13060,"thread_start_us":12909,"threads_started":1}
I20260812 11:10:10.571902 6918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.546967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58606 (local address 127.4.26.66:34957)
0812 11:10:10.561122 (+ 14155us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:10.561129 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:10.561185 (+ 56us) server_negotiation.cc:407] Connection header received
0812 11:10:10.561280 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:10.561286 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:10.561521 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:10.561713 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:10.563471 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.565019 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.567426 (+ 2407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.568885 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.569040 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:10.571320 (+ 2280us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:10.571424 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 11:10:10.571623 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14023,"thread_start_us":13910,"threads_started":1}
I20260812 11:10:10.573470 6288 tablet_service.cc:1467] Processing CreateTablet for tablet f8f343f933104f1fba738293a9f9b16f (DEFAULT_TABLE table=test-table [id=f165925191f34d20825e064b2003772c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:10.575138 6288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8f343f933104f1fba738293a9f9b16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:10.575861 6776 tablet_service.cc:1467] Processing CreateTablet for tablet f8f343f933104f1fba738293a9f9b16f (DEFAULT_TABLE table=test-table [id=f165925191f34d20825e064b2003772c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:10.575861 6523 tablet_service.cc:1467] Processing CreateTablet for tablet f8f343f933104f1fba738293a9f9b16f (DEFAULT_TABLE table=test-table [id=f165925191f34d20825e064b2003772c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:10.577510 6776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8f343f933104f1fba738293a9f9b16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:10.577533 6523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8f343f933104f1fba738293a9f9b16f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:10.589870 6920 tablet_bootstrap.cc:492] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629: Bootstrap starting.
I20260812 11:10:10.593456 6920 tablet_bootstrap.cc:654] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:10.594452 6924 tablet_bootstrap.cc:492] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627: Bootstrap starting.
I20260812 11:10:10.595386 6923 tablet_bootstrap.cc:492] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38: Bootstrap starting.
I20260812 11:10:10.596343 6920 log.cc:824] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:10.599215 6923 tablet_bootstrap.cc:654] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:10.599399 6924 tablet_bootstrap.cc:654] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:10.600106 6920 tablet_bootstrap.cc:492] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629: No bootstrap required, opened a new log
I20260812 11:10:10.600420 6920 ts_tablet_manager.cc:1397] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260812 11:10:10.600548 6923 log.cc:824] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:10.600569 6924 log.cc:824] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:10.603561 6924 tablet_bootstrap.cc:492] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627: No bootstrap required, opened a new log
I20260812 11:10:10.603886 6924 ts_tablet_manager.cc:1397] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260812 11:10:10.605661 6923 tablet_bootstrap.cc:492] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38: No bootstrap required, opened a new log
I20260812 11:10:10.605981 6923 ts_tablet_manager.cc:1397] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.003s
I20260812 11:10:10.611197 6920 raft_consensus.cc:348] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.611755 6920 raft_consensus.cc:374] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:10.611857 6920 raft_consensus.cc:729] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47f7254e3eac48d8839cae24bf83c629, State: Initialized, Role: FOLLOWER
I20260812 11:10:10.611634 6924 raft_consensus.cc:348] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.612054 6924 raft_consensus.cc:374] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:10.612151 6924 raft_consensus.cc:729] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6369a58e5805459fb64c27385e543627, State: Initialized, Role: FOLLOWER
I20260812 11:10:10.612725 6924 consensus_queue.cc:260] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.612694 6920 consensus_queue.cc:260] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.613858 6653 heartbeater.cc:503] Master 127.4.26.126:39515 was elected leader, sending a full tablet report...
I20260812 11:10:10.614434 6924 ts_tablet_manager.cc:1428] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627: Time spent starting tablet: real 0.010s user 0.007s sys 0.003s
I20260812 11:10:10.616441 6923 raft_consensus.cc:348] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.616935 6923 raft_consensus.cc:374] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:10.617063 6923 raft_consensus.cc:729] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1db5d0cb36f4a28a37d42cba1786d38, State: Initialized, Role: FOLLOWER
I20260812 11:10:10.617779 6923 consensus_queue.cc:260] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.619077 6896 heartbeater.cc:503] Master 127.4.26.126:39515 was elected leader, sending a full tablet report...
I20260812 11:10:10.619777 6923 ts_tablet_manager.cc:1428] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260812 11:10:10.621897 6920 ts_tablet_manager.cc:1428] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629: Time spent starting tablet: real 0.021s user 0.013s sys 0.007s
W20260812 11:10:10.654930 6655 tablet.cc:2369] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:10.675508 6935 raft_consensus.cc:482] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:10.675909 6935 raft_consensus.cc:504] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.677834 6935 leader_election.cc:288] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47f7254e3eac48d8839cae24bf83c629 (127.4.26.65:41449), a1db5d0cb36f4a28a37d42cba1786d38 (127.4.26.67:34751)
I20260812 11:10:10.686268 6919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.678417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:54735 (local address 127.4.26.67:34751)
0812 11:10:10.678643 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:10.678651 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:10.679477 (+ 826us) server_negotiation.cc:407] Connection header received
0812 11:10:10.679635 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:10.679638 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:10.679699 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:10.679782 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:10.680479 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.681333 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.684375 (+ 3042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.685297 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.685419 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:10.685552 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:10.685870 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 11:10:10.686010 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 11:10:10.686501 6939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.678306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:34751 (local address 127.4.26.66:54735)
0812 11:10:10.679343 (+ 1037us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:10.679362 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:10.679508 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:10.679818 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:10.679822 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:10.679846 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:10.680317 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:10.680326 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.681478 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.681482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:10.684134 (+ 2652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:10.684158 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.685519 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.685525 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:10.685667 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:10.685695 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 11:10:10.685792 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 11:10:10.685943 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":913,"mutex_wait_us":59,"thread_start_us":538,"threads_started":1}
I20260812 11:10:10.687507 6915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.678446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:58059 (local address 127.4.26.65:41449)
0812 11:10:10.678670 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:10.678678 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:10.679374 (+ 696us) server_negotiation.cc:407] Connection header received
0812 11:10:10.679566 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:10.679572 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:10.679666 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:10.679736 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:10.680581 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.681430 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.685657 (+ 4227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.686639 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.686784 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:10.686889 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:10.687217 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 11:10:10.687331 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 11:10:10.687719 6940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.678112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:41449 (local address 127.4.26.66:58059)
0812 11:10:10.679245 (+ 1133us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:10.679262 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:10.679408 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:10.679791 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:10.679795 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:10.679819 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:10.680422 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:10.680437 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.681588 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.681593 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:10.684134 (+ 2541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:10.684158 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.686886 (+ 2728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.686894 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:10.687059 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:10.687084 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:10:10.687186 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 11:10:10.687332 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1003,"mutex_wait_us":104,"thread_start_us":776,"threads_started":1}
I20260812 11:10:10.687759 6812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8f343f933104f1fba738293a9f9b16f" candidate_uuid: "6369a58e5805459fb64c27385e543627" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" is_pre_election: true
I20260812 11:10:10.688398 6812 raft_consensus.cc:2454] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6369a58e5805459fb64c27385e543627 in term 0.
I20260812 11:10:10.688701 6322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8f343f933104f1fba738293a9f9b16f" candidate_uuid: "6369a58e5805459fb64c27385e543627" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47f7254e3eac48d8839cae24bf83c629" is_pre_election: true
I20260812 11:10:10.689225 6443 leader_election.cc:302] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6369a58e5805459fb64c27385e543627, a1db5d0cb36f4a28a37d42cba1786d38; no voters:
I20260812 11:10:10.689312 6322 raft_consensus.cc:2454] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6369a58e5805459fb64c27385e543627 in term 0.
I20260812 11:10:10.689785 6935 raft_consensus.cc:2781] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:10.689951 6935 raft_consensus.cc:482] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:10.690091 6935 raft_consensus.cc:3037] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:10.692296 6935 raft_consensus.cc:504] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.692953 6935 leader_election.cc:288] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [CANDIDATE]: Term 1 election: Requested vote from peers 47f7254e3eac48d8839cae24bf83c629 (127.4.26.65:41449), a1db5d0cb36f4a28a37d42cba1786d38 (127.4.26.67:34751)
I20260812 11:10:10.693495 6322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8f343f933104f1fba738293a9f9b16f" candidate_uuid: "6369a58e5805459fb64c27385e543627" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47f7254e3eac48d8839cae24bf83c629"
I20260812 11:10:10.693580 6812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8f343f933104f1fba738293a9f9b16f" candidate_uuid: "6369a58e5805459fb64c27385e543627" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1db5d0cb36f4a28a37d42cba1786d38"
I20260812 11:10:10.693713 6322 raft_consensus.cc:3037] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:10.693800 6812 raft_consensus.cc:3037] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:10.696026 6322 raft_consensus.cc:2454] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6369a58e5805459fb64c27385e543627 in term 1.
I20260812 11:10:10.696130 6812 raft_consensus.cc:2454] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6369a58e5805459fb64c27385e543627 in term 1.
I20260812 11:10:10.696513 6439 leader_election.cc:302] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47f7254e3eac48d8839cae24bf83c629, 6369a58e5805459fb64c27385e543627; no voters:
I20260812 11:10:10.696870 6935 raft_consensus.cc:2781] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:10.697398 6935 raft_consensus.cc:686] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [term 1 LEADER]: Becoming Leader. State: Replica: 6369a58e5805459fb64c27385e543627, State: Running, Role: LEADER
I20260812 11:10:10.697964 6935 consensus_queue.cc:237] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.703459 6075 catalog_manager.cc:5495] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6369a58e5805459fb64c27385e543627 (127.4.26.66). New cstate: current_term: 1 leader_uuid: "6369a58e5805459fb64c27385e543627" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } health_report { overall_health: UNKNOWN } } }
W20260812 11:10:10.705420 6899 tablet.cc:2369] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:10.741516 6918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:10.735110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58608 (local address 127.4.26.66:34957)
0812 11:10:10.735349 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:10.735354 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:10.735448 (+ 94us) server_negotiation.cc:407] Connection header received
0812 11:10:10.735746 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:10.735750 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:10.735831 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:10.735960 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:10.736389 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.737258 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.738851 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:10.739329 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:10.739440 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:10.740073 (+ 633us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:10.740724 (+ 651us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:10.740849 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:10.741095 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 11:10:10.741226 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 11:10:10.751796 6812 raft_consensus.cc:1261] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38 [term 1 FOLLOWER]: Refusing update from remote peer 6369a58e5805459fb64c27385e543627: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:10.753187 6943 consensus_queue.cc:1035] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:10.753579 6322 raft_consensus.cc:1261] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629 [term 1 FOLLOWER]: Refusing update from remote peer 6369a58e5805459fb64c27385e543627: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:10.754482 6943 consensus_queue.cc:1035] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:10.766413 6946 mvcc.cc:205] Tried to move back new op lower bound from 7317639212024438784 to 7317639211823374336. Current Snapshot: MvccSnapshot[applied={T|T < 7317639212024438784}]
I20260812 11:10:10.790675 6078 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:10.791040 6078 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:10.795361 6078 catalog_manager.cc:5782] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac: Sending DeleteTablet for 3 replicas of tablet f8f343f933104f1fba738293a9f9b16f
I20260812 11:10:10.796991 6776 tablet_service.cc:1514] Processing DeleteTablet for tablet f8f343f933104f1fba738293a9f9b16f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:10 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:51226
I20260812 11:10:10.796958 6288 tablet_service.cc:1514] Processing DeleteTablet for tablet f8f343f933104f1fba738293a9f9b16f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:10 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:45206
I20260812 11:10:10.796958 6523 tablet_service.cc:1514] Processing DeleteTablet for tablet f8f343f933104f1fba738293a9f9b16f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:10 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:58606
I20260812 11:10:10.802435 6075 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34698:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:10:10.803325 6075 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:10.813629 6286 tablet_service.cc:1467] Processing CreateTablet for tablet 573ee62fb0bf4e26b8f6bd4caec75fbb (DEFAULT_TABLE table=test-table [id=7e89c871d42e41b6a9d34a88237208d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:10.814383 6286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 573ee62fb0bf4e26b8f6bd4caec75fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:10.818322 6775 tablet_service.cc:1467] Processing CreateTablet for tablet 573ee62fb0bf4e26b8f6bd4caec75fbb (DEFAULT_TABLE table=test-table [id=7e89c871d42e41b6a9d34a88237208d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:10.818774 6522 tablet_service.cc:1467] Processing CreateTablet for tablet 573ee62fb0bf4e26b8f6bd4caec75fbb (DEFAULT_TABLE table=test-table [id=7e89c871d42e41b6a9d34a88237208d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:10.819036 6775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 573ee62fb0bf4e26b8f6bd4caec75fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:10.819360 6522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 573ee62fb0bf4e26b8f6bd4caec75fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:10.823957 6920 tablet_bootstrap.cc:492] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629: Bootstrap starting.
I20260812 11:10:10.825349 6976 tablet_replica.cc:330] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627: stopping tablet replica
I20260812 11:10:10.826002 6920 tablet_bootstrap.cc:654] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:10.826210 6976 raft_consensus.cc:2229] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:10:10.827139 6976 raft_consensus.cc:2258] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:10.827896 6923 tablet_bootstrap.cc:492] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38: Bootstrap starting.
I20260812 11:10:10.828016 6971 tablet_replica.cc:330] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629: stopping tablet replica
I20260812 11:10:10.828300 6972 tablet_replica.cc:330] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38: stopping tablet replica
I20260812 11:10:10.828514 6971 raft_consensus.cc:2229] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:10.828866 6972 raft_consensus.cc:2229] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:10.829036 6971 raft_consensus.cc:2258] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:10.829610 6972 raft_consensus.cc:2258] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:10.830578 6924 tablet_bootstrap.cc:492] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627: Bootstrap starting.
I20260812 11:10:10.829792 6923 tablet_bootstrap.cc:654] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:10.831889 6920 tablet_bootstrap.cc:492] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629: No bootstrap required, opened a new log
I20260812 11:10:10.832064 6920 ts_tablet_manager.cc:1397] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260812 11:10:10.832265 6924 tablet_bootstrap.cc:654] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:10.832960 6920 raft_consensus.cc:348] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.833227 6920 raft_consensus.cc:374] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:10.833346 6920 raft_consensus.cc:729] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47f7254e3eac48d8839cae24bf83c629, State: Initialized, Role: FOLLOWER
I20260812 11:10:10.833691 6920 consensus_queue.cc:260] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.834302 6920 ts_tablet_manager.cc:1428] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:10.835718 6924 tablet_bootstrap.cc:492] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627: No bootstrap required, opened a new log
I20260812 11:10:10.835896 6924 ts_tablet_manager.cc:1397] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260812 11:10:10.836712 6976 ts_tablet_manager.cc:1905] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:10.836861 6924 raft_consensus.cc:348] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.837116 6924 raft_consensus.cc:374] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:10.837276 6924 raft_consensus.cc:729] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6369a58e5805459fb64c27385e543627, State: Initialized, Role: FOLLOWER
I20260812 11:10:10.837596 6924 consensus_queue.cc:260] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.838250 6924 ts_tablet_manager.cc:1428] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:10.839727 6972 ts_tablet_manager.cc:1905] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:10.840914 6971 ts_tablet_manager.cc:1905] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:10.847724 6972 ts_tablet_manager.cc:1918] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:10.848030 6972 log.cc:1196] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/f8f343f933104f1fba738293a9f9b16f
I20260812 11:10:10.848685 6972 ts_tablet_manager.cc:1939] T f8f343f933104f1fba738293a9f9b16f P a1db5d0cb36f4a28a37d42cba1786d38: Deleting consensus metadata
I20260812 11:10:10.851109 6055 catalog_manager.cc:4841] TS a1db5d0cb36f4a28a37d42cba1786d38 (127.4.26.67:34751): tablet f8f343f933104f1fba738293a9f9b16f (table test-table [id=f165925191f34d20825e064b2003772c]) successfully deleted
I20260812 11:10:10.852681 6976 ts_tablet_manager.cc:1918] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:10.852890 6976 log.cc:1196] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/f8f343f933104f1fba738293a9f9b16f
I20260812 11:10:10.853492 6976 ts_tablet_manager.cc:1939] T f8f343f933104f1fba738293a9f9b16f P 6369a58e5805459fb64c27385e543627: Deleting consensus metadata
I20260812 11:10:10.855252 6971 ts_tablet_manager.cc:1918] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:10.855459 6971 log.cc:1196] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/f8f343f933104f1fba738293a9f9b16f
I20260812 11:10:10.855686 6054 catalog_manager.cc:4841] TS 6369a58e5805459fb64c27385e543627 (127.4.26.66:34957): tablet f8f343f933104f1fba738293a9f9b16f (table test-table [id=f165925191f34d20825e064b2003772c]) successfully deleted
I20260812 11:10:10.856042 6971 ts_tablet_manager.cc:1939] T f8f343f933104f1fba738293a9f9b16f P 47f7254e3eac48d8839cae24bf83c629: Deleting consensus metadata
I20260812 11:10:10.857542 6923 tablet_bootstrap.cc:492] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38: No bootstrap required, opened a new log
I20260812 11:10:10.857740 6923 ts_tablet_manager.cc:1397] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38: Time spent bootstrapping tablet: real 0.030s user 0.008s sys 0.004s
I20260812 11:10:10.858065 6053 catalog_manager.cc:4841] TS 47f7254e3eac48d8839cae24bf83c629 (127.4.26.65:41449): tablet f8f343f933104f1fba738293a9f9b16f (table test-table [id=f165925191f34d20825e064b2003772c]) successfully deleted
W20260812 11:10:10.858282 6398 tablet.cc:2369] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:10.858577 6923 raft_consensus.cc:348] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.858765 6923 raft_consensus.cc:374] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:10.858826 6923 raft_consensus.cc:729] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1db5d0cb36f4a28a37d42cba1786d38, State: Initialized, Role: FOLLOWER
I20260812 11:10:10.859090 6923 consensus_queue.cc:260] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.860178 6923 ts_tablet_manager.cc:1428] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:10.947261 6943 raft_consensus.cc:482] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:10.947531 6943 raft_consensus.cc:504] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.948367 6943 leader_election.cc:288] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47f7254e3eac48d8839cae24bf83c629 (127.4.26.65:41449), a1db5d0cb36f4a28a37d42cba1786d38 (127.4.26.67:34751)
I20260812 11:10:10.949070 6812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "573ee62fb0bf4e26b8f6bd4caec75fbb" candidate_uuid: "6369a58e5805459fb64c27385e543627" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" is_pre_election: true
I20260812 11:10:10.949090 6322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "573ee62fb0bf4e26b8f6bd4caec75fbb" candidate_uuid: "6369a58e5805459fb64c27385e543627" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47f7254e3eac48d8839cae24bf83c629" is_pre_election: true
I20260812 11:10:10.949373 6812 raft_consensus.cc:2454] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6369a58e5805459fb64c27385e543627 in term 0.
I20260812 11:10:10.949385 6322 raft_consensus.cc:2454] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6369a58e5805459fb64c27385e543627 in term 0.
I20260812 11:10:10.949996 6443 leader_election.cc:302] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 47f7254e3eac48d8839cae24bf83c629, 6369a58e5805459fb64c27385e543627, a1db5d0cb36f4a28a37d42cba1786d38; no voters:
I20260812 11:10:10.950364 6943 raft_consensus.cc:2781] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:10.950515 6943 raft_consensus.cc:482] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:10.950618 6943 raft_consensus.cc:3037] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:10.954000 6943 raft_consensus.cc:504] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.954813 6943 leader_election.cc:288] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [CANDIDATE]: Term 1 election: Requested vote from peers 47f7254e3eac48d8839cae24bf83c629 (127.4.26.65:41449), a1db5d0cb36f4a28a37d42cba1786d38 (127.4.26.67:34751)
I20260812 11:10:10.955475 6812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "573ee62fb0bf4e26b8f6bd4caec75fbb" candidate_uuid: "6369a58e5805459fb64c27385e543627" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1db5d0cb36f4a28a37d42cba1786d38"
I20260812 11:10:10.955523 6322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "573ee62fb0bf4e26b8f6bd4caec75fbb" candidate_uuid: "6369a58e5805459fb64c27385e543627" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47f7254e3eac48d8839cae24bf83c629"
I20260812 11:10:10.955718 6812 raft_consensus.cc:3037] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:10.955765 6322 raft_consensus.cc:3037] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:10.958068 6812 raft_consensus.cc:2454] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6369a58e5805459fb64c27385e543627 in term 1.
I20260812 11:10:10.958659 6443 leader_election.cc:302] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6369a58e5805459fb64c27385e543627, a1db5d0cb36f4a28a37d42cba1786d38; no voters:
I20260812 11:10:10.958947 6322 raft_consensus.cc:2454] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6369a58e5805459fb64c27385e543627 in term 1.
I20260812 11:10:10.959012 6943 raft_consensus.cc:2781] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:10.959228 6943 raft_consensus.cc:686] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [term 1 LEADER]: Becoming Leader. State: Replica: 6369a58e5805459fb64c27385e543627, State: Running, Role: LEADER
I20260812 11:10:10.959563 6943 consensus_queue.cc:237] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:10.962653 6075 catalog_manager.cc:5495] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6369a58e5805459fb64c27385e543627 (127.4.26.66). New cstate: current_term: 1 leader_uuid: "6369a58e5805459fb64c27385e543627" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } health_report { overall_health: UNKNOWN } } }
Aug 12 11:10:11 dist-test-slave-rmhg krb5kdc[6003](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533008, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:11.038674 6992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.024027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34710 (local address 127.4.26.126:39515)
0812 11:10:11.024706 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:11.024711 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:11.025141 (+ 430us) server_negotiation.cc:407] Connection header received
0812 11:10:11.025342 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:11.025347 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:11.025407 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:11.025515 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:11.026793 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.027636 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.028884 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.029369 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.029492 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.032931 (+ 3439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:11.032936 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:11.032939 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:11.032970 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:11.035886 (+ 2916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:11.036634 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:11.036640 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:11.036644 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:11.036784 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:11.037181 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:11.037186 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:11.037190 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:11.037475 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:11.037622 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:11.038049 (+ 427us) server_negotiation.cc:299] Negotiation successful
0812 11:10:11.038263 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":325,"threads_started":1}
I20260812 11:10:11.038883 6990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.024006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:39515 (local address 127.0.0.1:34710)
0812 11:10:11.025020 (+ 1014us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:11.025039 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:11.025226 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:11.025553 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:11.025558 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:11.026337 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:11.026624 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:11.026635 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.027770 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.027774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:11.028740 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:11.028753 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.029571 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.029578 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:11.029765 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.030447 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:11.030471 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:11.032718 (+ 2247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:11.036028 (+ 3310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:11.036062 (+ 34us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:11.036069 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:11.036512 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:11.036890 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:11.036895 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:11.036899 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:11.037035 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:11.037610 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:11.037624 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:11.037800 (+ 176us) client_negotiation.cc:769] Sending connection context
0812 11:10:11.037948 (+ 148us) client_negotiation.cc:240] Negotiation successful
0812 11:10:11.038402 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":910,"mutex_wait_us":144,"thread_start_us":807,"threads_started":1}
I20260812 11:10:11.044368 6075 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:34710:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 11:10:11.045804 6075 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:11.053360 6288 tablet_service.cc:1467] Processing CreateTablet for tablet d11077d1a98b4b71b4c2b61f91f9c5bf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1543b00ae83c41fdad405b35de299597]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:10:11.053648 6775 tablet_service.cc:1467] Processing CreateTablet for tablet d11077d1a98b4b71b4c2b61f91f9c5bf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1543b00ae83c41fdad405b35de299597]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:10:11.053630 6522 tablet_service.cc:1467] Processing CreateTablet for tablet d11077d1a98b4b71b4c2b61f91f9c5bf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1543b00ae83c41fdad405b35de299597]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:10:11.054072 6288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d11077d1a98b4b71b4c2b61f91f9c5bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:11.054148 6775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d11077d1a98b4b71b4c2b61f91f9c5bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:11.054221 6522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d11077d1a98b4b71b4c2b61f91f9c5bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:11.061682 6924 tablet_bootstrap.cc:492] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627: Bootstrap starting.
I20260812 11:10:11.062767 6923 tablet_bootstrap.cc:492] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38: Bootstrap starting.
I20260812 11:10:11.063510 6924 tablet_bootstrap.cc:654] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:11.064023 6923 tablet_bootstrap.cc:654] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:11.066843 6924 tablet_bootstrap.cc:492] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627: No bootstrap required, opened a new log
I20260812 11:10:11.067037 6924 ts_tablet_manager.cc:1397] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260812 11:10:11.067149 6923 tablet_bootstrap.cc:492] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38: No bootstrap required, opened a new log
I20260812 11:10:11.067301 6923 ts_tablet_manager.cc:1397] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260812 11:10:11.067945 6924 raft_consensus.cc:348] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:11.068004 6923 raft_consensus.cc:348] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:11.068223 6923 raft_consensus.cc:374] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:11.068233 6924 raft_consensus.cc:374] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:11.068295 6923 raft_consensus.cc:729] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1db5d0cb36f4a28a37d42cba1786d38, State: Initialized, Role: FOLLOWER
I20260812 11:10:11.068315 6924 raft_consensus.cc:729] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6369a58e5805459fb64c27385e543627, State: Initialized, Role: FOLLOWER
I20260812 11:10:11.068588 6924 consensus_queue.cc:260] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:11.069274 6924 ts_tablet_manager.cc:1428] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260812 11:10:11.069095 6923 consensus_queue.cc:260] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:11.069700 6920 tablet_bootstrap.cc:492] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629: Bootstrap starting.
I20260812 11:10:11.070106 6923 ts_tablet_manager.cc:1428] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:10:11.070078 6937 tablet_replica.cc:439] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } } }
I20260812 11:10:11.070420 6937 tablet_replica.cc:442] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:10:11.071600 6920 tablet_bootstrap.cc:654] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:11.073508 6943 tablet_replica.cc:439] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } } }
I20260812 11:10:11.073864 6943 tablet_replica.cc:442] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:10:11.076314 6920 tablet_bootstrap.cc:492] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629: No bootstrap required, opened a new log
I20260812 11:10:11.076505 6920 ts_tablet_manager.cc:1397] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260812 11:10:11.077411 6920 raft_consensus.cc:348] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:11.077694 6920 raft_consensus.cc:374] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:11.077787 6920 raft_consensus.cc:729] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47f7254e3eac48d8839cae24bf83c629, State: Initialized, Role: FOLLOWER
I20260812 11:10:11.078043 6920 consensus_queue.cc:260] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:11.078775 6920 ts_tablet_manager.cc:1428] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:11.078603 6936 tablet_replica.cc:439] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } } }
I20260812 11:10:11.079047 6936 tablet_replica.cc:442] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:10:11.157557 6936 raft_consensus.cc:482] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:11.157800 6936 raft_consensus.cc:504] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:11.159593 6936 leader_election.cc:288] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6369a58e5805459fb64c27385e543627 (127.4.26.66:34957), a1db5d0cb36f4a28a37d42cba1786d38 (127.4.26.67:34751)
I20260812 11:10:11.168011 6919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.160278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:60539 (local address 127.4.26.67:34751)
0812 11:10:11.160482 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:11.160489 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:11.161532 (+ 1043us) server_negotiation.cc:407] Connection header received
0812 11:10:11.161718 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:11.161723 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:11.161813 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:11.161900 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:11.162618 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.163746 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.166205 (+ 2459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.167023 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.167148 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.167257 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:11.167597 (+ 340us) server_negotiation.cc:299] Negotiation successful
0812 11:10:11.167730 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 11:10:11.168152 6998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.160060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:34751 (local address 127.4.26.65:60539)
0812 11:10:11.161408 (+ 1348us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:11.161427 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:11.161574 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:11.161954 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:11.161959 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:11.161983 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:11.162391 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:11.162401 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.163892 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.163897 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:11.165977 (+ 2080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:11.165994 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.167255 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.167263 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:11.167418 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.167455 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:10:11.167543 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 11:10:11.167692 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1214,"mutex_wait_us":28,"thread_start_us":636,"threads_started":1}
I20260812 11:10:11.168789 6812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d11077d1a98b4b71b4c2b61f91f9c5bf" candidate_uuid: "47f7254e3eac48d8839cae24bf83c629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" is_pre_election: true
I20260812 11:10:11.169112 6812 raft_consensus.cc:2454] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47f7254e3eac48d8839cae24bf83c629 in term 0.
I20260812 11:10:11.169421 6918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.160348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:47023 (local address 127.4.26.66:34957)
0812 11:10:11.160537 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:11.160543 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:11.161241 (+ 698us) server_negotiation.cc:407] Connection header received
0812 11:10:11.161540 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:11.161544 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:11.161619 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:11.161704 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:11.162544 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.163404 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.166177 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.167525 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.167705 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.167807 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:11.168869 (+ 1062us) server_negotiation.cc:299] Negotiation successful
0812 11:10:11.169046 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:10:11.169703 6999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.159862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:34957 (local address 127.4.26.65:47023)
0812 11:10:11.161071 (+ 1209us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:11.161094 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:11.161370 (+ 276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:11.161758 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:11.161763 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:11.161790 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:11.162316 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:11.162339 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.163559 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.163564 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:11.165974 (+ 2410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:11.165994 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.167984 (+ 1990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.167991 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:11.168640 (+ 649us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.168693 (+ 53us) client_negotiation.cc:769] Sending connection context
0812 11:10:11.168796 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 11:10:11.168944 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1050,"mutex_wait_us":33,"thread_start_us":1231,"threads_started":1}
I20260812 11:10:11.170084 6207 leader_election.cc:302] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47f7254e3eac48d8839cae24bf83c629, a1db5d0cb36f4a28a37d42cba1786d38; no voters:
I20260812 11:10:11.170593 6936 raft_consensus.cc:2781] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:11.170738 6936 raft_consensus.cc:482] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:11.170873 6936 raft_consensus.cc:3037] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:11.170934 6568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d11077d1a98b4b71b4c2b61f91f9c5bf" candidate_uuid: "47f7254e3eac48d8839cae24bf83c629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6369a58e5805459fb64c27385e543627" is_pre_election: true
I20260812 11:10:11.171446 6568 raft_consensus.cc:2454] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47f7254e3eac48d8839cae24bf83c629 in term 0.
I20260812 11:10:11.173766 6936 raft_consensus.cc:504] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:11.174690 6936 leader_election.cc:288] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [CANDIDATE]: Term 1 election: Requested vote from peers 6369a58e5805459fb64c27385e543627 (127.4.26.66:34957), a1db5d0cb36f4a28a37d42cba1786d38 (127.4.26.67:34751)
I20260812 11:10:11.175228 6568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d11077d1a98b4b71b4c2b61f91f9c5bf" candidate_uuid: "47f7254e3eac48d8839cae24bf83c629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6369a58e5805459fb64c27385e543627"
I20260812 11:10:11.175374 6812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d11077d1a98b4b71b4c2b61f91f9c5bf" candidate_uuid: "47f7254e3eac48d8839cae24bf83c629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1db5d0cb36f4a28a37d42cba1786d38"
I20260812 11:10:11.175495 6568 raft_consensus.cc:3037] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:11.175637 6812 raft_consensus.cc:3037] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:11.178750 6812 raft_consensus.cc:2454] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47f7254e3eac48d8839cae24bf83c629 in term 1.
I20260812 11:10:11.178891 6568 raft_consensus.cc:2454] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47f7254e3eac48d8839cae24bf83c629 in term 1.
I20260812 11:10:11.179565 6207 leader_election.cc:302] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47f7254e3eac48d8839cae24bf83c629, a1db5d0cb36f4a28a37d42cba1786d38; no voters:
I20260812 11:10:11.179926 6936 raft_consensus.cc:2781] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:11.180454 6936 raft_consensus.cc:686] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [term 1 LEADER]: Becoming Leader. State: Replica: 47f7254e3eac48d8839cae24bf83c629, State: Running, Role: LEADER
I20260812 11:10:11.180912 6936 consensus_queue.cc:237] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } }
I20260812 11:10:11.183735 7000 tablet_replica.cc:439] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629: TxnStatusTablet state changed. Reason: New leader 47f7254e3eac48d8839cae24bf83c629. Latest consensus state: current_term: 1 leader_uuid: "47f7254e3eac48d8839cae24bf83c629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } } }
I20260812 11:10:11.184176 7000 tablet_replica.cc:442] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:10:11.185315 6075 catalog_manager.cc:5495] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47f7254e3eac48d8839cae24bf83c629 (127.4.26.65). New cstate: current_term: 1 leader_uuid: "47f7254e3eac48d8839cae24bf83c629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } health_report { overall_health: UNKNOWN } } }
I20260812 11:10:11.189358 7002 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 11:10:11.189788 7002 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 11:10:11.216178 7010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.206593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45210 (local address 127.4.26.65:41449)
0812 11:10:11.208180 (+ 1587us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:11.208187 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:11.208216 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:10:11.208324 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:11.208329 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:11.208442 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:11.208648 (+ 206us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:11.209274 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.210632 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.212692 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.213504 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.213654 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.214380 (+ 726us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:11.215294 (+ 914us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:11.215478 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:11.215639 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 11:10:11.215748 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1396,"thread_start_us":1217,"threads_started":1}
I20260812 11:10:11.216192 6990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.206461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:41449 (local address 127.0.0.1:45210)
0812 11:10:11.206716 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:11.206739 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:11.206912 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:11.208731 (+ 1819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:11.208738 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:11.208753 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:10:11.209025 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:11.209041 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.210813 (+ 1772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.210820 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:11.212482 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:11.212506 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.213717 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.213725 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:11.213982 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.214088 (+ 106us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:10:11.215447 (+ 1359us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:10:11.215482 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 11:10:11.215586 (+ 104us) client_negotiation.cc:240] Negotiation successful
0812 11:10:11.215786 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260812 11:10:11.222651 6568 raft_consensus.cc:1261] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627 [term 1 FOLLOWER]: Refusing update from remote peer 47f7254e3eac48d8839cae24bf83c629: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:11.222852 6812 raft_consensus.cc:1261] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38 [term 1 FOLLOWER]: Refusing update from remote peer 47f7254e3eac48d8839cae24bf83c629: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:11.223610 7000 consensus_queue.cc:1035] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:11.224359 7000 consensus_queue.cc:1035] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:11.234223 6937 tablet_replica.cc:439] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38: TxnStatusTablet state changed. Reason: New leader 47f7254e3eac48d8839cae24bf83c629. Latest consensus state: current_term: 1 leader_uuid: "47f7254e3eac48d8839cae24bf83c629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } } }
I20260812 11:10:11.234589 6937 tablet_replica.cc:442] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:10:11.239957 6936 tablet_replica.cc:439] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "47f7254e3eac48d8839cae24bf83c629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } } }
I20260812 11:10:11.240317 6936 tablet_replica.cc:442] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:10:11.242046 6951 mvcc.cc:205] Tried to move back new op lower bound from 7317639213956886528 to 7317639213801410560. Current Snapshot: MvccSnapshot[applied={T|T < 7317639213956886528 or (T in {7317639213956886528})}]
I20260812 11:10:11.243081 6937 tablet_replica.cc:439] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "47f7254e3eac48d8839cae24bf83c629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } } }
I20260812 11:10:11.243328 6937 tablet_replica.cc:442] T d11077d1a98b4b71b4c2b61f91f9c5bf P a1db5d0cb36f4a28a37d42cba1786d38: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:10:11.243484 6948 mvcc.cc:205] Tried to move back new op lower bound from 7317639213956886528 to 7317639213801410560. Current Snapshot: MvccSnapshot[applied={T|T < 7317639213956886528 or (T in {7317639213956886528})}]
I20260812 11:10:11.249766 6943 tablet_replica.cc:439] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627: TxnStatusTablet state changed. Reason: New leader 47f7254e3eac48d8839cae24bf83c629. Latest consensus state: current_term: 1 leader_uuid: "47f7254e3eac48d8839cae24bf83c629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } } }
I20260812 11:10:11.250172 6943 tablet_replica.cc:442] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:10:11.252898 7000 tablet_replica.cc:439] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "47f7254e3eac48d8839cae24bf83c629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } } }
I20260812 11:10:11.253221 7000 tablet_replica.cc:442] T d11077d1a98b4b71b4c2b61f91f9c5bf P 47f7254e3eac48d8839cae24bf83c629: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:10:11.257771 6943 tablet_replica.cc:439] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "47f7254e3eac48d8839cae24bf83c629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 } } peers { permanent_uuid: "6369a58e5805459fb64c27385e543627" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 34957 } } peers { permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 } } }
I20260812 11:10:11.258126 6943 tablet_replica.cc:442] T d11077d1a98b4b71b4c2b61f91f9c5bf P 6369a58e5805459fb64c27385e543627: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:10:11.276554 7010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.269007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:56305 (local address 127.4.26.65:41449)
0812 11:10:11.269338 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:11.269345 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:11.269832 (+ 487us) server_negotiation.cc:407] Connection header received
0812 11:10:11.270095 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:11.270101 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:11.270196 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:11.270389 (+ 193us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:11.270914 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.272089 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.274252 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.275014 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.275191 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.275749 (+ 558us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:11.275897 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:11.276005 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:11.276110 (+ 105us) server_negotiation.cc:299] Negotiation successful
0812 11:10:11.276203 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 11:10:11.276671 7016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.268882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:41449 (local address 127.4.26.66:56305)
0812 11:10:11.269708 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:11.269733 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:11.269900 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:11.270399 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:11.270404 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:11.270417 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:10:11.270721 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:11.270732 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.272247 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.272252 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:11.274063 (+ 1811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:11.274082 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.275234 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.275242 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:11.275477 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.275556 (+ 79us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:10:11.276002 (+ 446us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:10:11.276014 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 11:10:11.276088 (+ 74us) client_negotiation.cc:240] Negotiation successful
0812 11:10:11.276243 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":502,"threads_started":1}
I20260812 11:10:11.291291 6810 raft_consensus.cc:1261] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38 [term 1 FOLLOWER]: Refusing update from remote peer 6369a58e5805459fb64c27385e543627: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:11.291368 6322 raft_consensus.cc:1261] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629 [term 1 FOLLOWER]: Refusing update from remote peer 6369a58e5805459fb64c27385e543627: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:11.291971 6956 consensus_queue.cc:1035] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1db5d0cb36f4a28a37d42cba1786d38" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:11.292377 6943 consensus_queue.cc:1035] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47f7254e3eac48d8839cae24bf83c629" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 41449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:11.331930 6918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.324207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:35083 (local address 127.4.26.66:34957)
0812 11:10:11.324378 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:11.324385 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:11.325561 (+ 1176us) server_negotiation.cc:407] Connection header received
0812 11:10:11.325770 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:11.325777 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:11.325879 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:11.325987 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:11.326503 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.327646 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.329817 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.330508 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.330644 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.331135 (+ 491us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:11.331277 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:11.331372 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:11.331554 (+ 182us) server_negotiation.cc:299] Negotiation successful
0812 11:10:11.331646 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:10:11.332742 7028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.324290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:34957 (local address 127.4.26.65:35083)
0812 11:10:11.325433 (+ 1143us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:11.325460 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:11.325625 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:11.326008 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:11.326011 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:11.326021 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:10:11.326348 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:11.326357 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.327794 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.327801 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:11.329656 (+ 1855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:11.329673 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.330708 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.330713 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:11.330845 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.330922 (+ 77us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:10:11.331399 (+ 477us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:10:11.331413 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 11:10:11.331522 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 11:10:11.331881 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":922,"thread_start_us":721,"threads_started":1}
I20260812 11:10:11.372987 6071 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:11.373281 6071 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:11.377236 6071 catalog_manager.cc:5782] T 00000000000000000000000000000000 P de632b6fef67497e956394cb321dacac: Sending DeleteTablet for 3 replicas of tablet 573ee62fb0bf4e26b8f6bd4caec75fbb
I20260812 11:10:11.378125 6288 tablet_service.cc:1514] Processing DeleteTablet for tablet 573ee62fb0bf4e26b8f6bd4caec75fbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:11 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:45206
I20260812 11:10:11.378367 6775 tablet_service.cc:1514] Processing DeleteTablet for tablet 573ee62fb0bf4e26b8f6bd4caec75fbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:11 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:51226
I20260812 11:10:11.379142 6522 tablet_service.cc:1514] Processing DeleteTablet for tablet 573ee62fb0bf4e26b8f6bd4caec75fbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:11 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:58606
I20260812 11:10:11.398593 7034 tablet_replica.cc:330] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38: stopping tablet replica
I20260812 11:10:11.398864 7034 raft_consensus.cc:2229] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:11.399171 7034 raft_consensus.cc:2258] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:11.400871 7034 ts_tablet_manager.cc:1905] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:11.403939 7035 tablet_replica.cc:330] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627: stopping tablet replica
I20260812 11:10:11.404215 7035 raft_consensus.cc:2229] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:10:11.404680 7035 raft_consensus.cc:2258] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:11.409719 7035 ts_tablet_manager.cc:1905] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:11.413663 7032 tablet_replica.cc:330] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629: stopping tablet replica
I20260812 11:10:11.413901 7032 raft_consensus.cc:2229] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:11.414193 7032 raft_consensus.cc:2258] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:11.416253 7032 ts_tablet_manager.cc:1905] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:11.421590 7034 ts_tablet_manager.cc:1918] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:10:11.421783 7034 log.cc:1196] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/573ee62fb0bf4e26b8f6bd4caec75fbb
I20260812 11:10:11.422380 7034 ts_tablet_manager.cc:1939] T 573ee62fb0bf4e26b8f6bd4caec75fbb P a1db5d0cb36f4a28a37d42cba1786d38: Deleting consensus metadata
I20260812 11:10:11.423804 7032 ts_tablet_manager.cc:1918] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:10:11.424012 7032 log.cc:1196] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/573ee62fb0bf4e26b8f6bd4caec75fbb
I20260812 11:10:11.424337 6055 catalog_manager.cc:4841] TS a1db5d0cb36f4a28a37d42cba1786d38 (127.4.26.67:34751): tablet 573ee62fb0bf4e26b8f6bd4caec75fbb (table test-table [id=7e89c871d42e41b6a9d34a88237208d4]) successfully deleted
I20260812 11:10:11.424592 7032 ts_tablet_manager.cc:1939] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 47f7254e3eac48d8839cae24bf83c629: Deleting consensus metadata
I20260812 11:10:11.425922 6053 catalog_manager.cc:4841] TS 47f7254e3eac48d8839cae24bf83c629 (127.4.26.65:41449): tablet 573ee62fb0bf4e26b8f6bd4caec75fbb (table test-table [id=7e89c871d42e41b6a9d34a88237208d4]) successfully deleted
Aug 12 11:10:11 dist-test-slave-rmhg krb5kdc[6003](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533010, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:10:11.431641 7035 ts_tablet_manager.cc:1918] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:10:11.431938 7035 log.cc:1196] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/573ee62fb0bf4e26b8f6bd4caec75fbb
I20260812 11:10:11.432507 7035 ts_tablet_manager.cc:1939] T 573ee62fb0bf4e26b8f6bd4caec75fbb P 6369a58e5805459fb64c27385e543627: Deleting consensus metadata
I20260812 11:10:11.433923 6054 catalog_manager.cc:4841] TS 6369a58e5805459fb64c27385e543627 (127.4.26.66:34957): tablet 573ee62fb0bf4e26b8f6bd4caec75fbb (table test-table [id=7e89c871d42e41b6a9d34a88237208d4]) successfully deleted
I20260812 11:10:11.438535 7010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.402167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45216 (local address 127.4.26.65:41449)
0812 11:10:11.402400 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:11.402408 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:11.405598 (+ 3190us) server_negotiation.cc:407] Connection header received
0812 11:10:11.405958 (+ 360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:11.405965 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:11.406082 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:11.406175 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:11.414560 (+ 8385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.415473 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.422330 (+ 6857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.423080 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.423206 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.430227 (+ 7021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:11.430251 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:11.430276 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:11.430329 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:11.434629 (+ 4300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:11.435935 (+ 1306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:11.435946 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:11.435948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:11.436113 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:11.436620 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:11.436624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:11.436627 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:11.437063 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:11.437739 (+ 676us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:11.437915 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 11:10:11.438119 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
W20260812 11:10:11.439442 6391 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45216
I20260812 11:10:11.462560 6992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.443250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34720 (local address 127.4.26.126:39515)
0812 11:10:11.443495 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:11.443502 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:11.449271 (+ 5769us) server_negotiation.cc:407] Connection header received
0812 11:10:11.449483 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:11.449489 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:11.449597 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:11.449698 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:11.451212 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.452072 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.453452 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.453941 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.454066 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.456530 (+ 2464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:11.456536 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:11.456539 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:11.456579 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:11.459558 (+ 2979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:11.460363 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:11.460368 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:11.460370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:11.460519 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:11.460926 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:11.460930 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:11.460940 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:11.461322 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:11.461571 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:11.462001 (+ 430us) server_negotiation.cc:299] Negotiation successful
0812 11:10:11.462246 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260812 11:10:11.463197 6071 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34720
I20260812 11:10:11.465188 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 6180
I20260812 11:10:11.487957 7010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.466390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45226 (local address 127.4.26.65:41449)
0812 11:10:11.467456 (+ 1066us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:11.467464 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:11.474937 (+ 7473us) server_negotiation.cc:407] Connection header received
0812 11:10:11.475146 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:11.475152 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:11.475227 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:11.475327 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:11.476690 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.477550 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.478865 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.479338 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.479550 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.482009 (+ 2459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:11.482014 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:11.482018 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:11.482056 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:11.484977 (+ 2921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:11.485754 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:11.485759 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:11.485761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:11.485895 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:11.486304 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:11.486308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:11.486310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:11.486646 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:11.486950 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:11.487287 (+ 337us) server_negotiation.cc:299] Negotiation successful
0812 11:10:11.487591 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":855}
W20260812 11:10:11.488567 6391 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45226
W20260812 11:10:11.489184 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 6180: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:10:11.489385 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 6180
I20260812 11:10:11.527141 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 6407
Aug 12 11:10:11 dist-test-slave-rmhg krb5kdc[6003](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533010, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:10:11.543578 6918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.528112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58616 (local address 127.4.26.66:34957)
0812 11:10:11.528328 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:11.528333 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:11.528359 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:10:11.528421 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:11.528424 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:11.528532 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:11.528630 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:11.530362 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.531157 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.532446 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.532958 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.533077 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.537426 (+ 4349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:11.537446 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:11.537466 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:11.537509 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:11.540602 (+ 3093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:11.541481 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:11.541491 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:11.541494 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:11.541675 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:11.542097 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:11.542102 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:11.542105 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:11.542519 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:11.542774 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:11.543015 (+ 241us) server_negotiation.cc:299] Negotiation successful
0812 11:10:11.543241 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260812 11:10:11.544402 6647 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58616
W20260812 11:10:11.545012 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 6407: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:10:11.545248 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 6407
I20260812 11:10:11.586095 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 6658
Aug 12 11:10:11 dist-test-slave-rmhg krb5kdc[6003](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533010, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:10:11.605126 6919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:11.587060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51236 (local address 127.4.26.67:34751)
0812 11:10:11.587299 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:11.587304 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:11.587616 (+ 312us) server_negotiation.cc:407] Connection header received
0812 11:10:11.587875 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:11.587879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:11.588182 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:11.588322 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:11.590118 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.590850 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.592299 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:11.592801 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:11.592911 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:11.597961 (+ 5050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:11.597979 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:11.597999 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:11.598046 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:11.601758 (+ 3712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:11.602660 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:11.602670 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:11.602672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:11.602883 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:11.603404 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:11.603409 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:11.603411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:11.603845 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:11.604143 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:11.604575 (+ 432us) server_negotiation.cc:299] Negotiation successful
0812 11:10:11.604789 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
W20260812 11:10:11.605947 6886 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51236
W20260812 11:10:11.606652 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 6658: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:10:11.606802 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 6658
I20260812 11:10:11.633564 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 6023
I20260812 11:10:11.634853 6134 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:11.761390 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 6023
2026-08-12T11:10:11Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4972 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:11 dist-test-slave-rmhg krb5kdc[7047](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:11 dist-test-slave-rmhg krb5kdc[7047](info): set up 2 sockets
Aug 12 11:10:11 dist-test-slave-rmhg krb5kdc[7047](info): commencing operation
krb5kdc: starting...
W20260812 11:10:13.012584 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.007s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:10:13 dist-test-slave-rmhg krb5kdc[7047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:10:13.234982 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:36857
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:36857
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:13.583330 7066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:13.583699 7066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:13.583863 7066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:13.591559 7066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:13.591724 7066 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 11:10:13.591790 7066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:13.591874 7066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:13.591943 7066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:13.592033 7066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:13.602679 7066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:36857
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:36857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:13.604137 7066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:13.605760 7066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:13.618278 7076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:13.618247 7081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:13.618403 7074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:13.619690 7066 server_base.cc:1034] running on GCE node
I20260812 11:10:13.620536 7066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:13.622180 7066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:13.623441 7066 hybrid_clock.cc:648] HybridClock initialized: now 1786533013623365 us; error 52 us; skew 500 ppm
I20260812 11:10:13.623867 7066 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:13 dist-test-slave-rmhg krb5kdc[7047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533013, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:13.627403 7066 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:10:13.629350 7066 webserver.cc:460] Webserver started at http://127.4.26.126:46139/ using document root <none> and password file <none>
I20260812 11:10:13.630192 7066 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:13.630326 7066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:13.630695 7066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:13.634133 7066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "4ca7ee32de66492888329cd0ca9048c0"
format_stamp: "Formatted at 2026-08-12 11:10:13 on dist-test-slave-rmhg"
server_key: "a5737afbdfba60f6a8089f7c91c9dae8"
server_key_iv: "f11aefdabbbf30fac175715449673833"
server_key_version: "encryptionkey@0"
I20260812 11:10:13.635048 7066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "4ca7ee32de66492888329cd0ca9048c0"
format_stamp: "Formatted at 2026-08-12 11:10:13 on dist-test-slave-rmhg"
server_key: "a5737afbdfba60f6a8089f7c91c9dae8"
server_key_iv: "f11aefdabbbf30fac175715449673833"
server_key_version: "encryptionkey@0"
I20260812 11:10:13.641251 7066 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:10:13.645535 7089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:13.647291 7066 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:10:13.647506 7066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "4ca7ee32de66492888329cd0ca9048c0"
format_stamp: "Formatted at 2026-08-12 11:10:13 on dist-test-slave-rmhg"
server_key: "a5737afbdfba60f6a8089f7c91c9dae8"
server_key_iv: "f11aefdabbbf30fac175715449673833"
server_key_version: "encryptionkey@0"
I20260812 11:10:13.647769 7066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:13.680315 7066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:13.685784 7066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:13.686112 7066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:13.709204 7066 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:36857
I20260812 11:10:13.709227 7190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:36857 every 8 connection(s)
I20260812 11:10:13.710779 7066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:13.715310 7195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:13.717818 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 7066
I20260812 11:10:13.718060 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:10:13.718760 4201 external_mini_cluster.cc:1428] Setting key 8f5950d1f5904adc8222b556bbe3f0c2
I20260812 11:10:13.728175 7195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0: Bootstrap starting.
I20260812 11:10:13.732316 7195 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:13.733868 7195 log.cc:824] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:10:13 dist-test-slave-rmhg krb5kdc[7047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:13.737437 7195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0: No bootstrap required, opened a new log
I20260812 11:10:13.744351 7200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:13.720994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49040 (local address 127.4.26.126:36857)
0812 11:10:13.721942 (+ 948us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:13.721958 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:13.722012 (+ 54us) server_negotiation.cc:407] Connection header received
0812 11:10:13.723802 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:13.723829 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:13.724287 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:13.724702 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:13.726653 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.728093 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.729993 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:13.730843 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:13.731008 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:13.736222 (+ 5214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:13.736232 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:13.736249 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:13.736290 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:13.739548 (+ 3258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:13.740524 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:13.740536 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:13.740543 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:13.740747 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:13.741247 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:13.741252 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:13.741254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:13.741916 (+ 662us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:13.742176 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:13.742753 (+ 577us) server_negotiation.cc:299] Negotiation successful
0812 11:10:13.743235 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":709,"thread_start_us":448,"threads_started":1}
I20260812 11:10:13.746294 7195 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca7ee32de66492888329cd0ca9048c0" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 36857 } }
I20260812 11:10:13.746697 7195 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:13.746810 7195 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca7ee32de66492888329cd0ca9048c0, State: Initialized, Role: FOLLOWER
I20260812 11:10:13.747502 7195 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca7ee32de66492888329cd0ca9048c0" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 36857 } }
I20260812 11:10:13.747812 7195 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:13.747953 7195 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:13.748101 7195 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:13.750459 7195 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca7ee32de66492888329cd0ca9048c0" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 36857 } }
I20260812 11:10:13.751008 7195 leader_election.cc:302] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ca7ee32de66492888329cd0ca9048c0; no voters:
I20260812 11:10:13.751617 7195 leader_election.cc:288] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:13.751757 7202 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:13.752868 7202 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [term 1 LEADER]: Becoming Leader. State: Replica: 4ca7ee32de66492888329cd0ca9048c0, State: Running, Role: LEADER
I20260812 11:10:13.753602 7202 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca7ee32de66492888329cd0ca9048c0" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 36857 } }
I20260812 11:10:13.754062 7195 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:13.757477 7204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ca7ee32de66492888329cd0ca9048c0. Latest consensus state: current_term: 1 leader_uuid: "4ca7ee32de66492888329cd0ca9048c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca7ee32de66492888329cd0ca9048c0" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 36857 } } }
I20260812 11:10:13.757953 7204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:13.757463 7203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ca7ee32de66492888329cd0ca9048c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca7ee32de66492888329cd0ca9048c0" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 36857 } } }
I20260812 11:10:13.758168 7203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:13.761099 7212 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:13.767014 7212 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:13.777202 7212 catalog_manager.cc:1347] Generated new cluster ID: e043f278047f4e5e8cfff48661273f3d
I20260812 11:10:13.777354 7212 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:13.815896 7212 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:13.818097 7212 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:13.830137 7212 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0: Generated new TSK 0
I20260812 11:10:13.831364 7212 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:10:13.897948 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:36857
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:14.253346 7234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:14.253726 7234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:14.253893 7234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:14.261555 7234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:14.261713 7234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:14.261835 7234 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 11:10:14.261902 7234 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:10:14.262008 7234 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:10:14.273488 7234 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.26.126:36857
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:14.274935 7234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:14.276412 7234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:14.290752 7244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:14.290844 7248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:14.290870 7245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:14.292548 7234 server_base.cc:1034] running on GCE node
I20260812 11:10:14.293433 7234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:14.294626 7234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:14.295881 7234 hybrid_clock.cc:648] HybridClock initialized: now 1786533014295819 us; error 59 us; skew 500 ppm
I20260812 11:10:14.296284 7234 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:14 dist-test-slave-rmhg krb5kdc[7047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533014, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:14.299755 7234 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:10:14.301419 7234 webserver.cc:460] Webserver started at http://127.4.26.65:38293/ using document root <none> and password file <none>
I20260812 11:10:14.302179 7234 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:14.302291 7234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:14.302587 7234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:14.305920 7234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "03231e63bf9f4852a905da2939858da4"
format_stamp: "Formatted at 2026-08-12 11:10:14 on dist-test-slave-rmhg"
server_key: "12a9abc6fed7dc5ff5c8169bcec95f61"
server_key_iv: "8b89261df1dd349b3fed77c1b31fb95e"
server_key_version: "encryptionkey@0"
I20260812 11:10:14.306826 7234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "03231e63bf9f4852a905da2939858da4"
format_stamp: "Formatted at 2026-08-12 11:10:14 on dist-test-slave-rmhg"
server_key: "12a9abc6fed7dc5ff5c8169bcec95f61"
server_key_iv: "8b89261df1dd349b3fed77c1b31fb95e"
server_key_version: "encryptionkey@0"
I20260812 11:10:14.313423 7234 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 11:10:14.317636 7260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:14.319272 7234 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:10:14.319484 7234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "03231e63bf9f4852a905da2939858da4"
format_stamp: "Formatted at 2026-08-12 11:10:14 on dist-test-slave-rmhg"
server_key: "12a9abc6fed7dc5ff5c8169bcec95f61"
server_key_iv: "8b89261df1dd349b3fed77c1b31fb95e"
server_key_version: "encryptionkey@0"
I20260812 11:10:14.319713 7234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:14.340758 7234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:14.345618 7234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:14.345921 7234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:14.348796 7234 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:14.348919 7234 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:14.349047 7234 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:14.349134 7234 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:10:14 dist-test-slave-rmhg krb5kdc[7047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533014, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:14.377379 7280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:14.350459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:36857 (local address 127.4.26.65:36319)
0812 11:10:14.351398 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:14.351470 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:14.354408 (+ 2938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:14.355330 (+ 922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:14.355338 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:14.355896 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:14.356552 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:14.356572 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:14.358238 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:14.358245 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:14.360945 (+ 2700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:14.360968 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:14.362258 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:14.362264 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:14.362497 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:14.363347 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:14.363397 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:14.366544 (+ 3147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:14.370903 (+ 4359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:14.370915 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:14.370939 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:14.371844 (+ 905us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:14.372361 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:14.372372 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:14.372375 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:14.372744 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:14.373567 (+ 823us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:14.373582 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:14.374248 (+ 666us) client_negotiation.cc:769] Sending connection context
0812 11:10:14.374691 (+ 443us) client_negotiation.cc:240] Negotiation successful
0812 11:10:14.375438 (+ 747us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":358,"threads_started":1}
I20260812 11:10:14.380718 7279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:14.349807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:36319 (local address 127.4.26.126:36857)
0812 11:10:14.350361 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:14.350368 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:14.351628 (+ 1260us) server_negotiation.cc:407] Connection header received
0812 11:10:14.354798 (+ 3170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:14.354805 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:14.354906 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:14.355058 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:14.356746 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:14.357979 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:14.361195 (+ 3216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:14.361900 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:14.362078 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:14.366934 (+ 4856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:14.366943 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:14.366948 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:14.367005 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:14.370681 (+ 3676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:14.372028 (+ 1347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:14.372035 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:14.372038 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:14.372199 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:14.372907 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:14.372913 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:14.372916 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:14.373390 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:14.373560 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:14.374838 (+ 1278us) server_negotiation.cc:299] Negotiation successful
0812 11:10:14.380273 (+ 5435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":261,"threads_started":1}
I20260812 11:10:14.399358 7234 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:36111
I20260812 11:10:14.399451 7465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:36111 every 8 connection(s)
I20260812 11:10:14.401093 7234 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:14.402279 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 7234
I20260812 11:10:14.402513 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:14.403385 4201 external_mini_cluster.cc:1428] Setting key 388381ecd4fdf675dfe23cb1e4e3754b
I20260812 11:10:14.403941 7467 heartbeater.cc:347] Connected to a master server at 127.4.26.126:36857
I20260812 11:10:14.404233 7467 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:14.405297 7467 heartbeater.cc:511] Master 127.4.26.126:36857 requested a full tablet report, sending...
I20260812 11:10:14.407863 7120 ts_manager.cc:194] Registered new tserver with Master: 03231e63bf9f4852a905da2939858da4 (127.4.26.65:36111)
I20260812 11:10:14.407956 7436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:14.392114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:36857 (local address 127.4.26.65:53651)
0812 11:10:14.392893 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:14.392918 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:14.393132 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:14.393566 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:14.393570 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:14.394233 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:14.394741 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:14.394763 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:14.396292 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:14.396299 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:14.397572 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:14.397594 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:14.398659 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:14.398664 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:14.398806 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:14.399519 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:14.399545 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:14.400624 (+ 1079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:14.404596 (+ 3972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:14.404602 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:14.404606 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:14.405228 (+ 622us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:14.405822 (+ 594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:14.405827 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:14.405830 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:14.405997 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:14.406757 (+ 760us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:14.406762 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:14.406976 (+ 214us) client_negotiation.cc:769] Sending connection context
0812 11:10:14.407127 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 11:10:14.407490 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":390,"threads_started":1}
I20260812 11:10:14.409374 7279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:14.392136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:53651 (local address 127.4.26.126:36857)
0812 11:10:14.392367 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:14.392375 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:14.393057 (+ 682us) server_negotiation.cc:407] Connection header received
0812 11:10:14.393300 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:14.393306 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:14.393397 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:14.393500 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:14.394974 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:14.396120 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:14.397765 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:14.398470 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:14.398625 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:14.400841 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:14.400846 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:14.400850 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:14.400887 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:14.404392 (+ 3505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:14.405473 (+ 1081us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:14.405479 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:14.405483 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:14.405665 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:14.406142 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:14.406148 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:14.406150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:14.406506 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:14.406681 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:14.408725 (+ 2044us) server_negotiation.cc:299] Negotiation successful
0812 11:10:14.408986 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 11:10:14.410007 7120 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:36319
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:10:14.456650 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:36857
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:14.820920 7471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:14.821349 7471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:14.821527 7471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:14.829322 7471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:14.829473 7471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:14.829622 7471 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 11:10:14.829690 7471 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:10:14.829798 7471 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:10:14.840770 7471 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.26.126:36857
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:14.842343 7471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:14.843887 7471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:14.859555 7479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:14.859488 7481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:14.859520 7483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:14.861593 7471 server_base.cc:1034] running on GCE node
I20260812 11:10:14.862566 7471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:14.863991 7471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:14.865463 7471 hybrid_clock.cc:648] HybridClock initialized: now 1786533014865343 us; error 72 us; skew 500 ppm
I20260812 11:10:14.866027 7471 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:14 dist-test-slave-rmhg krb5kdc[7047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533014, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:14.874290 7471 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:10:14.876183 7471 webserver.cc:460] Webserver started at http://127.4.26.66:37747/ using document root <none> and password file <none>
I20260812 11:10:14.877029 7471 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:14.877215 7471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:14.877586 7471 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:14.880976 7471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7"
format_stamp: "Formatted at 2026-08-12 11:10:14 on dist-test-slave-rmhg"
server_key: "6f43e5bd2b60380057f88d29f83c2795"
server_key_iv: "6bc3173d4cdd8917d058a2b6cd0c71e1"
server_key_version: "encryptionkey@0"
I20260812 11:10:14.881959 7471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7"
format_stamp: "Formatted at 2026-08-12 11:10:14 on dist-test-slave-rmhg"
server_key: "6f43e5bd2b60380057f88d29f83c2795"
server_key_iv: "6bc3173d4cdd8917d058a2b6cd0c71e1"
server_key_version: "encryptionkey@0"
I20260812 11:10:14.889367 7471 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.006s
I20260812 11:10:14.893875 7498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:14.895643 7471 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:10:14.895860 7471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7"
format_stamp: "Formatted at 2026-08-12 11:10:14 on dist-test-slave-rmhg"
server_key: "6f43e5bd2b60380057f88d29f83c2795"
server_key_iv: "6bc3173d4cdd8917d058a2b6cd0c71e1"
server_key_version: "encryptionkey@0"
I20260812 11:10:14.896099 7471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:14.922710 7471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:14.927842 7471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:14.928169 7471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:14.931422 7471 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:14.931578 7471 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:14.931720 7471 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:14.931818 7471 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:10:14 dist-test-slave-rmhg krb5kdc[7047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533014, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:14.958390 7515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:14.931985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:42075 (local address 127.4.26.126:36857)
0812 11:10:14.932747 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:14.932752 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:14.933926 (+ 1174us) server_negotiation.cc:407] Connection header received
0812 11:10:14.936230 (+ 2304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:14.936236 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:14.936331 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:14.936433 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:14.939211 (+ 2778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:14.940709 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:14.943913 (+ 3204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:14.944524 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:14.944665 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:14.950054 (+ 5389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:14.950065 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:14.950071 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:14.950132 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:14.953857 (+ 3725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:14.955266 (+ 1409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:14.955273 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:14.955277 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:14.955462 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:14.956150 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:14.956155 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:14.956159 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:14.956577 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:14.956738 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:14.957718 (+ 980us) server_negotiation.cc:299] Negotiation successful
0812 11:10:14.957989 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":535,"threads_started":1}
I20260812 11:10:14.959553 7517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:14.932739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:36857 (local address 127.4.26.66:42075)
0812 11:10:14.933731 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:14.933788 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:14.935900 (+ 2112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:14.936801 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:14.936814 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:14.937799 (+ 985us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:14.938873 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:14.938908 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:14.940971 (+ 2063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:14.940981 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:14.943583 (+ 2602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:14.943608 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:14.944822 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:14.944833 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:14.945100 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:14.946098 (+ 998us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:14.946125 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:14.949662 (+ 3537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:14.954171 (+ 4509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:14.954186 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:14.954209 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:14.954981 (+ 772us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:14.955608 (+ 627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:14.955613 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:14.955617 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:14.956002 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:14.956732 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:14.956742 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:14.957238 (+ 496us) client_negotiation.cc:769] Sending connection context
0812 11:10:14.957582 (+ 344us) client_negotiation.cc:240] Negotiation successful
0812 11:10:14.958208 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":440,"threads_started":1}
I20260812 11:10:14.986343 7471 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:46479
I20260812 11:10:14.986380 7710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:46479 every 8 connection(s)
I20260812 11:10:14.988083 7471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:14.990252 7648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:14.972560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:36857 (local address 127.4.26.66:36469)
0812 11:10:14.973447 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:14.973476 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:14.973694 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:14.974178 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:14.974183 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:14.974972 (+ 789us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:14.975541 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:14.975561 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:14.977143 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:14.977181 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:14.978651 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:14.978672 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:14.979840 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:14.979847 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:14.980107 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:14.980971 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:14.981000 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:14.982405 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:14.986726 (+ 4321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:14.986731 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:14.986734 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:14.987202 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:14.987751 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:14.987756 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:14.987759 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:14.987935 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:14.988817 (+ 882us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:14.988829 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:14.989203 (+ 374us) client_negotiation.cc:769] Sending connection context
0812 11:10:14.989386 (+ 183us) client_negotiation.cc:240] Negotiation successful
0812 11:10:14.989853 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":468,"threads_started":1}
I20260812 11:10:14.990869 7714 heartbeater.cc:347] Connected to a master server at 127.4.26.126:36857
I20260812 11:10:14.991496 7714 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:14.991575 7515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:14.972492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:36469 (local address 127.4.26.126:36857)
0812 11:10:14.972707 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:14.972714 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:14.973614 (+ 900us) server_negotiation.cc:407] Connection header received
0812 11:10:14.973871 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:14.973879 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:14.973980 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:14.974110 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:14.975776 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:14.976970 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:14.978856 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:14.979580 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:14.979740 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:14.982699 (+ 2959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:14.982707 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:14.982711 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:14.982761 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:14.986502 (+ 3741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:14.987374 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:14.987381 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:14.987385 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:14.987585 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:14.988134 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:14.988140 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:14.988143 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:14.988652 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:14.988831 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:14.990708 (+ 1877us) server_negotiation.cc:299] Negotiation successful
0812 11:10:14.991137 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 11:10:14.991987 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 7471
I20260812 11:10:14.992165 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:14.992429 7714 heartbeater.cc:511] Master 127.4.26.126:36857 requested a full tablet report, sending...
I20260812 11:10:14.992591 4201 external_mini_cluster.cc:1428] Setting key 4569cf97014a122a7dd2a703d2160dbf
I20260812 11:10:14.994448 7119 ts_manager.cc:194] Registered new tserver with Master: 9bdcdb72c6f54fc5a3f1313ad76ea1a7 (127.4.26.66:46479)
I20260812 11:10:14.995388 7119 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:42075
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:10:15.045606 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:36857
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:15.393729 7722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:15.394064 7722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:15.394218 7722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:15.401989 7722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:15.402139 7722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:15.402264 7722 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 11:10:15.402334 7722 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:10:15.402446 7722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:10:15.412801 7722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.26.126:36857
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:15.414249 7722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:15.415376 7467 heartbeater.cc:503] Master 127.4.26.126:36857 was elected leader, sending a full tablet report...
I20260812 11:10:15.415776 7722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:15.430419 7737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:15.430454 7732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:15.430495 7733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:15.431411 7722 server_base.cc:1034] running on GCE node
I20260812 11:10:15.432129 7722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:15.433264 7722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:15.434496 7722 hybrid_clock.cc:648] HybridClock initialized: now 1786533015434458 us; error 74 us; skew 500 ppm
I20260812 11:10:15.434875 7722 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:15 dist-test-slave-rmhg krb5kdc[7047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533015, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:15.438462 7722 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:10:15.440223 7722 webserver.cc:460] Webserver started at http://127.4.26.67:39397/ using document root <none> and password file <none>
I20260812 11:10:15.440996 7722 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:15.441131 7722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:15.441510 7722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:15.444751 7722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "7dc9801be94a4a2ab46dfde75bd895da"
format_stamp: "Formatted at 2026-08-12 11:10:15 on dist-test-slave-rmhg"
server_key: "a144b636bd59d00cd65fb9fccee84e88"
server_key_iv: "35d8b594ab171ad3b9b7ef1ea361ee5a"
server_key_version: "encryptionkey@0"
I20260812 11:10:15.445634 7722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "7dc9801be94a4a2ab46dfde75bd895da"
format_stamp: "Formatted at 2026-08-12 11:10:15 on dist-test-slave-rmhg"
server_key: "a144b636bd59d00cd65fb9fccee84e88"
server_key_iv: "35d8b594ab171ad3b9b7ef1ea361ee5a"
server_key_version: "encryptionkey@0"
I20260812 11:10:15.451623 7722 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 11:10:15.456110 7755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:15.457923 7722 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260812 11:10:15.458117 7722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "7dc9801be94a4a2ab46dfde75bd895da"
format_stamp: "Formatted at 2026-08-12 11:10:15 on dist-test-slave-rmhg"
server_key: "a144b636bd59d00cd65fb9fccee84e88"
server_key_iv: "35d8b594ab171ad3b9b7ef1ea361ee5a"
server_key_version: "encryptionkey@0"
I20260812 11:10:15.458346 7722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:15.497064 7722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:15.502367 7722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:15.502718 7722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:15.505803 7722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:15.505937 7722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:15.506074 7722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:15.506155 7722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:10:15 dist-test-slave-rmhg krb5kdc[7047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533015, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:15.533056 7771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.506670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:34585 (local address 127.4.26.126:36857)
0812 11:10:15.507298 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:15.507305 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:15.508521 (+ 1216us) server_negotiation.cc:407] Connection header received
0812 11:10:15.511078 (+ 2557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:15.511085 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:15.511210 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:15.511307 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:15.514191 (+ 2884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.515278 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.517917 (+ 2639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.518657 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.518835 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.524399 (+ 5564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:15.524409 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:15.524416 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:15.524489 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:15.528562 (+ 4073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:15.529870 (+ 1308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:15.529878 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:15.529882 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:15.530120 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:15.530799 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:15.530805 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:15.530809 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:15.531256 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:15.531427 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:15.532358 (+ 931us) server_negotiation.cc:299] Negotiation successful
0812 11:10:15.532644 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":217,"threads_started":1}
I20260812 11:10:15.534258 7772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.507363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:36857 (local address 127.4.26.67:34585)
0812 11:10:15.508294 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:15.508351 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:15.510613 (+ 2262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:15.511984 (+ 1371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:15.511999 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:15.512932 (+ 933us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:15.513934 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:15.513958 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.515581 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.515587 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:15.517663 (+ 2076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:15.517690 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.519010 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.519019 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:15.519402 (+ 383us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.520199 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:15.520251 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:15.523902 (+ 3651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:15.528824 (+ 4922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:15.528833 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:15.528856 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:15.529680 (+ 824us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:15.530268 (+ 588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:15.530272 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:15.530274 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:15.530644 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:15.531407 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:15.531417 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:15.531893 (+ 476us) client_negotiation.cc:769] Sending connection context
0812 11:10:15.532184 (+ 291us) client_negotiation.cc:240] Negotiation successful
0812 11:10:15.532825 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":384,"threads_started":1}
I20260812 11:10:15.556468 7722 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:43597
I20260812 11:10:15.556492 7948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:43597 every 8 connection(s)
I20260812 11:10:15.558072 7722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:15.558336 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 7722
I20260812 11:10:15.558499 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:15.559075 4201 external_mini_cluster.cc:1428] Setting key 8b6e9c1c9773fa26fc7593d6e4c264a2
I20260812 11:10:15.560549 7949 heartbeater.cc:347] Connected to a master server at 127.4.26.126:36857
I20260812 11:10:15.560899 7949 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:15.561815 7915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.542353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:36857 (local address 127.4.26.67:36501)
0812 11:10:15.545823 (+ 3470us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:15.545852 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:15.546088 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:15.546465 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:15.546471 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:15.547145 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:15.547575 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:15.547592 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.548899 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.548905 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:15.550726 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:15.550747 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.551667 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.551674 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:15.551866 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.552751 (+ 885us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:15.552781 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:15.554346 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:15.557946 (+ 3600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:15.557961 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:15.557965 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:15.558579 (+ 614us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:15.559181 (+ 602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:15.559188 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:15.559193 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:15.559382 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:15.560224 (+ 842us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:15.560230 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:15.560494 (+ 264us) client_negotiation.cc:769] Sending connection context
0812 11:10:15.560654 (+ 160us) client_negotiation.cc:240] Negotiation successful
0812 11:10:15.561100 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3250,"thread_start_us":3059,"threads_started":1}
I20260812 11:10:15.562703 7949 heartbeater.cc:511] Master 127.4.26.126:36857 requested a full tablet report, sending...
I20260812 11:10:15.563086 7771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.542282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:36501 (local address 127.4.26.126:36857)
0812 11:10:15.542498 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:15.542505 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:15.546020 (+ 3515us) server_negotiation.cc:407] Connection header received
0812 11:10:15.546217 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:15.546222 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:15.546301 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:15.546415 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:15.547789 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.548753 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.550945 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.551444 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.551572 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.554628 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:15.554636 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:15.554642 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:15.554689 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:15.557773 (+ 3084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:15.558786 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:15.558794 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:15.558798 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:15.559013 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:15.559515 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:15.559520 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:15.559524 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:15.559973 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:15.560150 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:15.562334 (+ 2184us) server_negotiation.cc:299] Negotiation successful
0812 11:10:15.562701 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 11:10:15.564905 7119 ts_manager.cc:194] Registered new tserver with Master: 7dc9801be94a4a2ab46dfde75bd895da (127.4.26.67:43597)
I20260812 11:10:15.565747 7119 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:34585
I20260812 11:10:15.576203 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:10:15 dist-test-slave-rmhg krb5kdc[7047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:10:15 dist-test-slave-rmhg krb5kdc[7047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:15.631791 7771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.616276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49042 (local address 127.4.26.126:36857)
0812 11:10:15.616582 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:15.616594 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:15.616967 (+ 373us) server_negotiation.cc:407] Connection header received
0812 11:10:15.617138 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:15.617142 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:15.617260 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:15.617357 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:15.618878 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.619688 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.621102 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.621607 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.621721 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.626126 (+ 4405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:15.626132 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:15.626135 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:15.626182 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:15.628967 (+ 2785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:15.629804 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:15.629809 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:15.629812 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:15.629972 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:15.630350 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:15.630354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:15.630356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:15.630694 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:15.630909 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:15.631244 (+ 335us) server_negotiation.cc:299] Negotiation successful
0812 11:10:15.631433 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 11:10:15.636448 7119 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49042:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:10:15.643580 7119 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:15.683708 7977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.657887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:46479 (local address 127.0.0.1:57296)
0812 11:10:15.673877 (+ 15990us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:15.673941 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:15.674202 (+ 261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:15.675819 (+ 1617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:15.675827 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:15.675862 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:15.676308 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:15.676326 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.678646 (+ 2320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.678652 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:15.680827 (+ 2175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:15.680842 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.682648 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.682655 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:15.682926 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.682996 (+ 70us) client_negotiation.cc:769] Sending connection context
0812 11:10:15.683147 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 11:10:15.683343 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15681,"mutex_wait_us":27,"thread_start_us":15501,"threads_started":1}
I20260812 11:10:15.684768 7980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.658041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57296 (local address 127.4.26.66:46479)
0812 11:10:15.673817 (+ 15776us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:15.673829 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:15.675081 (+ 1252us) server_negotiation.cc:407] Connection header received
0812 11:10:15.675217 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:15.675224 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:15.675553 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:15.675783 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:15.676594 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.678479 (+ 1885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.681054 (+ 2575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.682382 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.682520 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.682770 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:15.684276 (+ 1506us) server_negotiation.cc:299] Negotiation successful
0812 11:10:15.684470 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15528,"thread_start_us":15797,"threads_started":1}
I20260812 11:10:15.685621 7982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.660512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:36111 (local address 127.0.0.1:60426)
0812 11:10:15.676702 (+ 16190us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:15.676721 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:15.676853 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:15.677483 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:15.677488 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:15.677514 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:15.677915 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:15.677928 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.679907 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.679916 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:15.682164 (+ 2248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:15.682187 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.684753 (+ 2566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.684761 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:15.685022 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.685062 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 11:10:15.685138 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 11:10:15.685302 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16057,"mutex_wait_us":36,"thread_start_us":14405,"threads_started":1}
I20260812 11:10:15.686367 7986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.658128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:43597 (local address 127.0.0.1:46360)
0812 11:10:15.675285 (+ 17157us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:15.675311 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:15.675479 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:15.676919 (+ 1440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:15.676923 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:15.676952 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:15.677376 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:15.677391 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.679577 (+ 2186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.679583 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:15.682019 (+ 2436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:15.682038 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.685466 (+ 3428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.685474 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:15.685662 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.685698 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:10:15.685807 (+ 109us) client_negotiation.cc:240] Negotiation successful
0812 11:10:15.685987 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16979,"mutex_wait_us":7,"thread_start_us":18289,"threads_started":1}
I20260812 11:10:15.687342 7983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.658468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46360 (local address 127.4.26.67:43597)
0812 11:10:15.676207 (+ 17739us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:15.676218 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:15.676260 (+ 42us) server_negotiation.cc:407] Connection header received
0812 11:10:15.676372 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:15.676382 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:15.676676 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:15.677559 (+ 883us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:15.677889 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.679427 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.682267 (+ 2840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.684654 (+ 2387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.684782 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.685266 (+ 484us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:15.686778 (+ 1512us) server_negotiation.cc:299] Negotiation successful
0812 11:10:15.687002 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17490,"thread_start_us":17520,"threads_started":1}
I20260812 11:10:15.689821 7987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.661346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60426 (local address 127.4.26.65:36111)
0812 11:10:15.674721 (+ 13375us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:15.674732 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:15.676863 (+ 2131us) server_negotiation.cc:407] Connection header received
0812 11:10:15.676977 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:15.676985 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:15.677273 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:15.677498 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:15.678212 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.679742 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.682369 (+ 2627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.684465 (+ 2096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.684673 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.689342 (+ 4669us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:15.689429 (+ 87us) server_negotiation.cc:299] Negotiation successful
0812 11:10:15.689596 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13202,"thread_start_us":13051,"threads_started":1}
I20260812 11:10:15.689744 7596 tablet_service.cc:1467] Processing CreateTablet for tablet 95920f0b349e4cb09a73d64b2d18ca43 (DEFAULT_TABLE table=test-table [id=ed332d98347640ddb4776f68fe63a037]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:15.691465 7596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95920f0b349e4cb09a73d64b2d18ca43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:15.691547 7841 tablet_service.cc:1467] Processing CreateTablet for tablet 95920f0b349e4cb09a73d64b2d18ca43 (DEFAULT_TABLE table=test-table [id=ed332d98347640ddb4776f68fe63a037]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:15.693574 7841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95920f0b349e4cb09a73d64b2d18ca43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:15.693112 7344 tablet_service.cc:1467] Processing CreateTablet for tablet 95920f0b349e4cb09a73d64b2d18ca43 (DEFAULT_TABLE table=test-table [id=ed332d98347640ddb4776f68fe63a037]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:15.694703 7344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95920f0b349e4cb09a73d64b2d18ca43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:15.706465 7988 tablet_bootstrap.cc:492] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4: Bootstrap starting.
I20260812 11:10:15.711831 7988 tablet_bootstrap.cc:654] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:15.713605 7988 log.cc:824] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:15.717875 7989 tablet_bootstrap.cc:492] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Bootstrap starting.
I20260812 11:10:15.719936 7991 tablet_bootstrap.cc:492] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da: Bootstrap starting.
I20260812 11:10:15.721978 7988 tablet_bootstrap.cc:492] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4: No bootstrap required, opened a new log
I20260812 11:10:15.722306 7988 ts_tablet_manager.cc:1397] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.010s
I20260812 11:10:15.724180 7991 tablet_bootstrap.cc:654] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:15.724192 7989 tablet_bootstrap.cc:654] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:15.725764 7989 log.cc:824] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:15.725762 7991 log.cc:824] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:15.733552 7988 raft_consensus.cc:348] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } }
I20260812 11:10:15.734088 7988 raft_consensus.cc:374] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:15.734208 7988 raft_consensus.cc:729] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03231e63bf9f4852a905da2939858da4, State: Initialized, Role: FOLLOWER
I20260812 11:10:15.735159 7989 tablet_bootstrap.cc:492] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: No bootstrap required, opened a new log
I20260812 11:10:15.734995 7988 consensus_queue.cc:260] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } }
I20260812 11:10:15.735282 7991 tablet_bootstrap.cc:492] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da: No bootstrap required, opened a new log
I20260812 11:10:15.735476 7989 ts_tablet_manager.cc:1397] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.003s
I20260812 11:10:15.735576 7991 ts_tablet_manager.cc:1397] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.000s
I20260812 11:10:15.737298 7988 ts_tablet_manager.cc:1428] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260812 11:10:15.744839 7989 raft_consensus.cc:348] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } }
I20260812 11:10:15.745299 7989 raft_consensus.cc:374] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:15.745400 7989 raft_consensus.cc:729] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdcdb72c6f54fc5a3f1313ad76ea1a7, State: Initialized, Role: FOLLOWER
I20260812 11:10:15.745139 7991 raft_consensus.cc:348] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } }
I20260812 11:10:15.745638 7991 raft_consensus.cc:374] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:15.745743 7991 raft_consensus.cc:729] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dc9801be94a4a2ab46dfde75bd895da, State: Initialized, Role: FOLLOWER
I20260812 11:10:15.746057 7989 consensus_queue.cc:260] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } }
I20260812 11:10:15.746336 7991 consensus_queue.cc:260] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } }
I20260812 11:10:15.747202 7714 heartbeater.cc:503] Master 127.4.26.126:36857 was elected leader, sending a full tablet report...
I20260812 11:10:15.747856 7991 ts_tablet_manager.cc:1428] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da: Time spent starting tablet: real 0.012s user 0.007s sys 0.006s
I20260812 11:10:15.747947 7989 ts_tablet_manager.cc:1428] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260812 11:10:15.748052 7949 heartbeater.cc:503] Master 127.4.26.126:36857 was elected leader, sending a full tablet report...
W20260812 11:10:15.814282 7951 tablet.cc:2369] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:15.889797 7997 raft_consensus.cc:482] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:15.890179 7997 raft_consensus.cc:504] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } }
I20260812 11:10:15.892122 7997 leader_election.cc:288] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dc9801be94a4a2ab46dfde75bd895da (127.4.26.67:43597), 03231e63bf9f4852a905da2939858da4 (127.4.26.65:36111)
I20260812 11:10:15.899672 7983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.892563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:45571 (local address 127.4.26.67:43597)
0812 11:10:15.892806 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:15.892813 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:15.893680 (+ 867us) server_negotiation.cc:407] Connection header received
0812 11:10:15.893927 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:15.893933 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:15.894001 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:15.894077 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:15.894725 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.895507 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.897526 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.898564 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.898721 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.898831 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:15.899240 (+ 409us) server_negotiation.cc:299] Negotiation successful
0812 11:10:15.899406 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 11:10:15.899677 7987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.892803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:33515 (local address 127.4.26.65:36111)
0812 11:10:15.893079 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:15.893085 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:15.893804 (+ 719us) server_negotiation.cc:407] Connection header received
0812 11:10:15.893959 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:15.893963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:15.894037 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:15.894178 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:15.894844 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.895562 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.897657 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.898473 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.898604 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.898721 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:15.899246 (+ 525us) server_negotiation.cc:299] Negotiation successful
0812 11:10:15.899387 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260812 11:10:15.900249 8003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.892691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:36111 (local address 127.4.26.66:33515)
0812 11:10:15.893694 (+ 1003us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:15.893712 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:15.893835 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:15.894212 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:15.894216 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:15.894253 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:15.894686 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:15.894697 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.895701 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.895704 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:15.897405 (+ 1701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:15.897421 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.898800 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.898808 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:15.899065 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.899095 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 11:10:15.899185 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 11:10:15.899402 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":865,"mutex_wait_us":105,"thread_start_us":609,"threads_started":1}
I20260812 11:10:15.900283 7999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:15.892390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:43597 (local address 127.4.26.66:45571)
0812 11:10:15.893486 (+ 1096us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:15.893510 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:15.893745 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:15.894115 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:15.894120 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:15.894146 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:15.894526 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:15.894536 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.895691 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.895697 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:15.897340 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:15.897355 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:15.898847 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:15.898852 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:15.899019 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:15.899090 (+ 71us) client_negotiation.cc:769] Sending connection context
0812 11:10:15.899186 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 11:10:15.899384 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":936,"mutex_wait_us":47,"thread_start_us":654,"threads_started":1}
I20260812 11:10:15.901464 7382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95920f0b349e4cb09a73d64b2d18ca43" candidate_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03231e63bf9f4852a905da2939858da4" is_pre_election: true
I20260812 11:10:15.901465 7871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95920f0b349e4cb09a73d64b2d18ca43" candidate_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc9801be94a4a2ab46dfde75bd895da" is_pre_election: true
I20260812 11:10:15.901999 7871 raft_consensus.cc:2454] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdcdb72c6f54fc5a3f1313ad76ea1a7 in term 0.
I20260812 11:10:15.901995 7382 raft_consensus.cc:2454] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdcdb72c6f54fc5a3f1313ad76ea1a7 in term 0.
I20260812 11:10:15.902783 7505 leader_election.cc:302] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03231e63bf9f4852a905da2939858da4, 9bdcdb72c6f54fc5a3f1313ad76ea1a7; no voters:
I20260812 11:10:15.903257 7997 raft_consensus.cc:2781] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:15.903439 7997 raft_consensus.cc:482] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:15.903556 7997 raft_consensus.cc:3037] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:15.905879 7997 raft_consensus.cc:504] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } }
I20260812 11:10:15.906554 7997 leader_election.cc:288] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [CANDIDATE]: Term 1 election: Requested vote from peers 7dc9801be94a4a2ab46dfde75bd895da (127.4.26.67:43597), 03231e63bf9f4852a905da2939858da4 (127.4.26.65:36111)
I20260812 11:10:15.907092 7871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95920f0b349e4cb09a73d64b2d18ca43" candidate_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc9801be94a4a2ab46dfde75bd895da"
I20260812 11:10:15.907152 7382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95920f0b349e4cb09a73d64b2d18ca43" candidate_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03231e63bf9f4852a905da2939858da4"
I20260812 11:10:15.907292 7871 raft_consensus.cc:3037] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:15.907375 7382 raft_consensus.cc:3037] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:15.909643 7871 raft_consensus.cc:2454] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdcdb72c6f54fc5a3f1313ad76ea1a7 in term 1.
I20260812 11:10:15.909802 7382 raft_consensus.cc:2454] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdcdb72c6f54fc5a3f1313ad76ea1a7 in term 1.
I20260812 11:10:15.910175 7500 leader_election.cc:302] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dc9801be94a4a2ab46dfde75bd895da, 9bdcdb72c6f54fc5a3f1313ad76ea1a7; no voters:
I20260812 11:10:15.910512 7997 raft_consensus.cc:2781] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:15.910933 7997 raft_consensus.cc:686] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 LEADER]: Becoming Leader. State: Replica: 9bdcdb72c6f54fc5a3f1313ad76ea1a7, State: Running, Role: LEADER
I20260812 11:10:15.911428 7997 consensus_queue.cc:237] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } }
W20260812 11:10:15.916911 7468 tablet.cc:2369] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:15.916584 7120 catalog_manager.cc:5495] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bdcdb72c6f54fc5a3f1313ad76ea1a7 (127.4.26.66). New cstate: current_term: 1 leader_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } health_report { overall_health: UNKNOWN } } }
W20260812 11:10:15.990846 7716 tablet.cc:2369] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 12 11:10:16 dist-test-slave-rmhg krb5kdc[7047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533013, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:16.026458 8020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.012051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:36857 (local address 127.0.0.1:49048)
0812 11:10:16.012770 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:16.012789 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:16.012928 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:16.013277 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:16.013280 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:16.014080 (+ 800us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:16.014334 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.014344 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.015459 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.015464 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.016466 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.016479 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.017293 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.017298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.017419 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.018139 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:16.018157 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:16.020467 (+ 2310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:16.023637 (+ 3170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:16.023650 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:16.023657 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:16.024162 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:16.024657 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:16.024661 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:16.024663 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:16.024822 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:16.025521 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:16.025528 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:16.025685 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 11:10:16.025838 (+ 153us) client_negotiation.cc:240] Negotiation successful
0812 11:10:16.026106 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":412,"threads_started":1}
I20260812 11:10:16.026528 7771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.012055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49048 (local address 127.4.26.126:36857)
0812 11:10:16.012289 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.012295 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.012874 (+ 579us) server_negotiation.cc:407] Connection header received
0812 11:10:16.013058 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.013062 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.013123 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.013231 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:16.014523 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.015317 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.016664 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.017110 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.017236 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.020685 (+ 3449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:16.020691 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:16.020694 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:16.020727 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:16.023433 (+ 2706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:16.024307 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:16.024311 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:16.024314 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:16.024528 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:16.024938 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:16.024943 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:16.024946 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:16.025345 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:16.025516 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.025989 (+ 473us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.026235 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":101}
I20260812 11:10:16.031920 7120 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:49048:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 11:10:16.033103 7120 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:16.040503 7841 tablet_service.cc:1467] Processing CreateTablet for tablet 98cee24acc854c0b8c0cc8e558f2b3ec (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ad3bcaee2f1046ae93bd9f967b0bce66]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:10:16.040438 7344 tablet_service.cc:1467] Processing CreateTablet for tablet 98cee24acc854c0b8c0cc8e558f2b3ec (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ad3bcaee2f1046ae93bd9f967b0bce66]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:10:16.040468 7596 tablet_service.cc:1467] Processing CreateTablet for tablet 98cee24acc854c0b8c0cc8e558f2b3ec (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ad3bcaee2f1046ae93bd9f967b0bce66]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:10:16.041481 7344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98cee24acc854c0b8c0cc8e558f2b3ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:16.041495 7841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98cee24acc854c0b8c0cc8e558f2b3ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:16.041491 7596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98cee24acc854c0b8c0cc8e558f2b3ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:16.048012 7988 tablet_bootstrap.cc:492] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4: Bootstrap starting.
I20260812 11:10:16.048933 7991 tablet_bootstrap.cc:492] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da: Bootstrap starting.
I20260812 11:10:16.049609 7989 tablet_bootstrap.cc:492] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Bootstrap starting.
I20260812 11:10:16.049875 7988 tablet_bootstrap.cc:654] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:16.050669 7991 tablet_bootstrap.cc:654] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:16.051208 7989 tablet_bootstrap.cc:654] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:16.052501 7988 tablet_bootstrap.cc:492] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4: No bootstrap required, opened a new log
I20260812 11:10:16.052668 7988 ts_tablet_manager.cc:1397] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:10:16.053509 7989 tablet_bootstrap.cc:492] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: No bootstrap required, opened a new log
I20260812 11:10:16.053630 7991 tablet_bootstrap.cc:492] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da: No bootstrap required, opened a new log
I20260812 11:10:16.053668 7989 ts_tablet_manager.cc:1397] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 11:10:16.053587 7988 raft_consensus.cc:348] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.053786 7991 ts_tablet_manager.cc:1397] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:10:16.053877 7988 raft_consensus.cc:374] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:16.053978 7988 raft_consensus.cc:729] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03231e63bf9f4852a905da2939858da4, State: Initialized, Role: FOLLOWER
I20260812 11:10:16.054240 7988 consensus_queue.cc:260] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.054570 7989 raft_consensus.cc:348] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.054601 7991 raft_consensus.cc:348] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.054812 7989 raft_consensus.cc:374] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:16.054847 7991 raft_consensus.cc:374] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:16.054872 7988 ts_tablet_manager.cc:1428] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:16.054905 7989 raft_consensus.cc:729] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdcdb72c6f54fc5a3f1313ad76ea1a7, State: Initialized, Role: FOLLOWER
I20260812 11:10:16.055208 7989 consensus_queue.cc:260] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.055270 7996 tablet_replica.cc:439] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } }
I20260812 11:10:16.055688 7996 tablet_replica.cc:442] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:10:16.055889 7989 ts_tablet_manager.cc:1428] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:16.056031 7997 tablet_replica.cc:439] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } }
I20260812 11:10:16.056339 7997 tablet_replica.cc:442] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:10:16.054941 7991 raft_consensus.cc:729] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dc9801be94a4a2ab46dfde75bd895da, State: Initialized, Role: FOLLOWER
I20260812 11:10:16.056806 7991 consensus_queue.cc:260] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.057439 7991 ts_tablet_manager.cc:1428] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260812 11:10:16.058719 7998 tablet_replica.cc:439] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } }
I20260812 11:10:16.059006 7998 tablet_replica.cc:442] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:10:16.172079 7996 raft_consensus.cc:482] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:16.172327 7996 raft_consensus.cc:504] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.173931 7996 leader_election.cc:288] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bdcdb72c6f54fc5a3f1313ad76ea1a7 (127.4.26.66:46479), 7dc9801be94a4a2ab46dfde75bd895da (127.4.26.67:43597)
I20260812 11:10:16.182639 7983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.174383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:54219 (local address 127.4.26.67:43597)
0812 11:10:16.174564 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.174571 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.175140 (+ 569us) server_negotiation.cc:407] Connection header received
0812 11:10:16.175306 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.175312 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.175389 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.175490 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:16.176270 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.177449 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.180366 (+ 2917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.181630 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.181796 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.181902 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.182249 (+ 347us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.182388 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:10:16.182910 8030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.174232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:43597 (local address 127.4.26.65:54219)
0812 11:10:16.175028 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:16.175043 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:16.175173 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:16.175515 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:16.175520 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:16.175555 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:16.176088 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.176099 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.177598 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.177603 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.180172 (+ 2569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.180185 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.181903 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.181908 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.182072 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.182100 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 11:10:16.182194 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 11:10:16.182298 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"mutex_wait_us":143,"spinlock_wait_cycles":4736,"thread_start_us":468,"threads_started":1}
I20260812 11:10:16.182967 8028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.174232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:46479 (local address 127.4.26.65:42031)
0812 11:10:16.174951 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:16.174971 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:16.175173 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:16.175515 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:16.175520 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:16.175597 (+ 77us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:16.176084 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.176099 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.177613 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.177617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.180167 (+ 2550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.180185 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.182069 (+ 1884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.182075 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.182235 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.182268 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 11:10:16.182360 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 11:10:16.182487 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"mutex_wait_us":111,"spinlock_wait_cycles":23680,"thread_start_us":456,"threads_started":1}
I20260812 11:10:16.183316 7980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.174378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:42031 (local address 127.4.26.66:46479)
0812 11:10:16.174680 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.174688 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.175072 (+ 384us) server_negotiation.cc:407] Connection header received
0812 11:10:16.175306 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.175311 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.175389 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.175490 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:16.176271 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.177426 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.180371 (+ 2945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.181678 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.181821 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.181916 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.182420 (+ 504us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.182601 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:10:16.183614 7871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98cee24acc854c0b8c0cc8e558f2b3ec" candidate_uuid: "03231e63bf9f4852a905da2939858da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc9801be94a4a2ab46dfde75bd895da" is_pre_election: true
I20260812 11:10:16.183941 7871 raft_consensus.cc:2454] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03231e63bf9f4852a905da2939858da4 in term 0.
I20260812 11:10:16.184146 7631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98cee24acc854c0b8c0cc8e558f2b3ec" candidate_uuid: "03231e63bf9f4852a905da2939858da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" is_pre_election: true
I20260812 11:10:16.184664 7631 raft_consensus.cc:2454] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03231e63bf9f4852a905da2939858da4 in term 0.
I20260812 11:10:16.184756 7261 leader_election.cc:302] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03231e63bf9f4852a905da2939858da4, 7dc9801be94a4a2ab46dfde75bd895da; no voters:
I20260812 11:10:16.185261 7996 raft_consensus.cc:2781] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:16.185422 7996 raft_consensus.cc:482] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:16.185534 7996 raft_consensus.cc:3037] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:16.187817 7996 raft_consensus.cc:504] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.188450 7996 leader_election.cc:288] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [CANDIDATE]: Term 1 election: Requested vote from peers 9bdcdb72c6f54fc5a3f1313ad76ea1a7 (127.4.26.66:46479), 7dc9801be94a4a2ab46dfde75bd895da (127.4.26.67:43597)
I20260812 11:10:16.189047 7871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98cee24acc854c0b8c0cc8e558f2b3ec" candidate_uuid: "03231e63bf9f4852a905da2939858da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc9801be94a4a2ab46dfde75bd895da"
I20260812 11:10:16.189064 7631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98cee24acc854c0b8c0cc8e558f2b3ec" candidate_uuid: "03231e63bf9f4852a905da2939858da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7"
I20260812 11:10:16.189288 7631 raft_consensus.cc:3037] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:16.189317 7871 raft_consensus.cc:3037] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:16.191506 7631 raft_consensus.cc:2454] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03231e63bf9f4852a905da2939858da4 in term 1.
I20260812 11:10:16.191525 7871 raft_consensus.cc:2454] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03231e63bf9f4852a905da2939858da4 in term 1.
I20260812 11:10:16.192050 7267 leader_election.cc:302] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03231e63bf9f4852a905da2939858da4, 9bdcdb72c6f54fc5a3f1313ad76ea1a7; no voters:
I20260812 11:10:16.192510 7996 raft_consensus.cc:2781] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:16.192998 7996 raft_consensus.cc:686] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [term 1 LEADER]: Becoming Leader. State: Replica: 03231e63bf9f4852a905da2939858da4, State: Running, Role: LEADER
I20260812 11:10:16.193605 7996 consensus_queue.cc:237] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.197275 8032 tablet_replica.cc:439] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4: TxnStatusTablet state changed. Reason: New leader 03231e63bf9f4852a905da2939858da4. Latest consensus state: current_term: 1 leader_uuid: "03231e63bf9f4852a905da2939858da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } }
I20260812 11:10:16.197775 8032 tablet_replica.cc:442] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:10:16.198616 8036 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 11:10:16.198943 8036 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 11:10:16.199429 7119 catalog_manager.cc:5495] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03231e63bf9f4852a905da2939858da4 (127.4.26.65). New cstate: current_term: 1 leader_uuid: "03231e63bf9f4852a905da2939858da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260812 11:10:16.254294 8020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.246858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:36111 (local address 127.0.0.1:60438)
0812 11:10:16.247162 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:16.247183 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:16.247354 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:16.247959 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:16.247963 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:16.248115 (+ 152us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:10:16.248326 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.248336 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.250024 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.250029 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.251081 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.251097 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.252158 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.252185 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.252379 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.252456 (+ 77us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:10:16.253705 (+ 1249us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:10:16.253739 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:10:16.253823 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 11:10:16.253969 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260812 11:10:16.254395 7987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.246975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60438 (local address 127.4.26.65:36111)
0812 11:10:16.247147 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.247153 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.247286 (+ 133us) server_negotiation.cc:407] Connection header received
0812 11:10:16.247579 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.247586 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.247733 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.247915 (+ 182us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:16.248513 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.249843 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.251255 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.251973 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.252117 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.252681 (+ 564us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:16.253532 (+ 851us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:16.253709 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.253870 (+ 161us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.253971 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:10:16.264379 7871 raft_consensus.cc:1261] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Refusing update from remote peer 03231e63bf9f4852a905da2939858da4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:16.264384 7631 raft_consensus.cc:1261] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 FOLLOWER]: Refusing update from remote peer 03231e63bf9f4852a905da2939858da4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:16.265550 8032 consensus_queue.cc:1035] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:16.265940 7996 consensus_queue.cc:1035] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:16.278035 7998 tablet_replica.cc:439] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da: TxnStatusTablet state changed. Reason: New leader 03231e63bf9f4852a905da2939858da4. Latest consensus state: current_term: 1 leader_uuid: "03231e63bf9f4852a905da2939858da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } }
I20260812 11:10:16.278424 7998 tablet_replica.cc:442] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:10:16.281613 8040 mvcc.cc:205] Tried to move back new op lower bound from 7317639234606047232 to 7317639234332798976. Current Snapshot: MvccSnapshot[applied={T|T < 7317639234606047232}]
I20260812 11:10:16.285538 7996 tablet_replica.cc:439] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03231e63bf9f4852a905da2939858da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } }
I20260812 11:10:16.286185 7996 tablet_replica.cc:442] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:10:16.293025 7998 tablet_replica.cc:439] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03231e63bf9f4852a905da2939858da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } }
I20260812 11:10:16.293356 7998 tablet_replica.cc:442] T 98cee24acc854c0b8c0cc8e558f2b3ec P 7dc9801be94a4a2ab46dfde75bd895da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:10:16.300321 7997 tablet_replica.cc:439] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: TxnStatusTablet state changed. Reason: New leader 03231e63bf9f4852a905da2939858da4. Latest consensus state: current_term: 1 leader_uuid: "03231e63bf9f4852a905da2939858da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } }
I20260812 11:10:16.300715 7997 tablet_replica.cc:442] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:10:16.302032 7996 tablet_replica.cc:439] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03231e63bf9f4852a905da2939858da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } }
I20260812 11:10:16.302399 7996 tablet_replica.cc:442] T 98cee24acc854c0b8c0cc8e558f2b3ec P 03231e63bf9f4852a905da2939858da4: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:10:16.306057 7997 tablet_replica.cc:439] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03231e63bf9f4852a905da2939858da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } } }
I20260812 11:10:16.306404 7997 tablet_replica.cc:442] T 98cee24acc854c0b8c0cc8e558f2b3ec P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:10:16.314240 7980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.301249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57304 (local address 127.4.26.66:46479)
0812 11:10:16.301460 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.301466 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.305751 (+ 4285us) server_negotiation.cc:407] Connection header received
0812 11:10:16.307084 (+ 1333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.307090 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.307227 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.307368 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:16.309098 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.309933 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.311493 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.311915 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.312043 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.312647 (+ 604us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:16.313513 (+ 866us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:16.313682 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.313788 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.313894 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 11:10:16.323172 7997 consensus_queue.cc:1035] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:16.333046 7997 consensus_queue.cc:1035] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:16.348866 7987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.328198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:34847 (local address 127.4.26.65:36111)
0812 11:10:16.328411 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.328419 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.342327 (+ 13908us) server_negotiation.cc:407] Connection header received
0812 11:10:16.342550 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.342556 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.342684 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.342776 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:16.343591 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.344975 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.346954 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.347443 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.347565 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.348101 (+ 536us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:16.348224 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:16.348314 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.348457 (+ 143us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.348547 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260812 11:10:16.348980 8061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.326991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:36111 (local address 127.4.26.66:34847)
0812 11:10:16.342196 (+ 15205us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:16.342219 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:16.342401 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:16.342967 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:16.342972 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:16.342988 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:10:16.343358 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.343373 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.345173 (+ 1800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.345181 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.346794 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.346816 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.347657 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.347663 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.347796 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.347870 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:10:16.348330 (+ 460us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:10:16.348344 (+ 14us) client_negotiation.cc:769] Sending connection context
0812 11:10:16.348417 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 11:10:16.348599 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14956,"thread_start_us":14802,"threads_started":1}
I20260812 11:10:16.399914 7980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.390197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:36051 (local address 127.4.26.66:46479)
0812 11:10:16.390396 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:16.390403 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:16.393995 (+ 3592us) server_negotiation.cc:407] Connection header received
0812 11:10:16.394251 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:16.394255 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:16.394331 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:16.394417 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:16.395091 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.396014 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.397925 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.398524 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.398656 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.399156 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:16.399269 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:16.399366 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:16.399538 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 11:10:16.399626 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:10:16.400183 8066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:16.390134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:46479 (local address 127.4.26.65:36051)
0812 11:10:16.393829 (+ 3695us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:16.393861 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:16.394040 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:16.394460 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:16.394465 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:16.394479 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:10:16.394897 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.394910 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.396173 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.396178 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.397777 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:16.397794 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:16.398716 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:16.398724 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:16.398884 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:16.398952 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:10:16.399418 (+ 466us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:10:16.399427 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 11:10:16.399498 (+ 71us) client_negotiation.cc:240] Negotiation successful
0812 11:10:16.399661 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3415,"thread_start_us":3232,"threads_started":1}
I20260812 11:10:16.455546 7119 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:16.455893 7119 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:16.461243 7119 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0: Sending DeleteTablet for 3 replicas of tablet 95920f0b349e4cb09a73d64b2d18ca43
I20260812 11:10:16.462702 7596 tablet_service.cc:1514] Processing DeleteTablet for tablet 95920f0b349e4cb09a73d64b2d18ca43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:16 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:57296
I20260812 11:10:16.462723 7841 tablet_service.cc:1514] Processing DeleteTablet for tablet 95920f0b349e4cb09a73d64b2d18ca43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:16 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:46360
I20260812 11:10:16.464258 7344 tablet_service.cc:1514] Processing DeleteTablet for tablet 95920f0b349e4cb09a73d64b2d18ca43 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:16 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:60426
I20260812 11:10:16.468835 7119 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49042:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:10:16.471204 7119 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:16.473938 8073 tablet_replica.cc:330] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4: stopping tablet replica
I20260812 11:10:16.475230 8073 raft_consensus.cc:2229] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:16.476261 8073 raft_consensus.cc:2258] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:16.478909 8073 ts_tablet_manager.cc:1905] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:16.484200 7594 tablet_service.cc:1467] Processing CreateTablet for tablet efd19abc7c2744079248f073443b4276 (DEFAULT_TABLE table=test-table [id=dd72fda031a84b4c9188ea8a441a026d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:16.484860 7594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efd19abc7c2744079248f073443b4276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:16.484858 7344 tablet_service.cc:1467] Processing CreateTablet for tablet efd19abc7c2744079248f073443b4276 (DEFAULT_TABLE table=test-table [id=dd72fda031a84b4c9188ea8a441a026d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:16.485086 7839 tablet_service.cc:1467] Processing CreateTablet for tablet efd19abc7c2744079248f073443b4276 (DEFAULT_TABLE table=test-table [id=dd72fda031a84b4c9188ea8a441a026d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:16.485355 7344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efd19abc7c2744079248f073443b4276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:16.485666 7839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efd19abc7c2744079248f073443b4276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:16.491967 7989 tablet_bootstrap.cc:492] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Bootstrap starting.
I20260812 11:10:16.493913 7989 tablet_bootstrap.cc:654] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:16.494735 7991 tablet_bootstrap.cc:492] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da: Bootstrap starting.
I20260812 11:10:16.496498 7989 tablet_bootstrap.cc:492] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: No bootstrap required, opened a new log
I20260812 11:10:16.496589 7991 tablet_bootstrap.cc:654] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:16.496690 7989 ts_tablet_manager.cc:1397] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 11:10:16.497577 7989 raft_consensus.cc:348] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.497844 7989 raft_consensus.cc:374] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:16.497927 7989 raft_consensus.cc:729] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdcdb72c6f54fc5a3f1313ad76ea1a7, State: Initialized, Role: FOLLOWER
I20260812 11:10:16.498256 7989 consensus_queue.cc:260] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.498978 7989 ts_tablet_manager.cc:1428] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:16.500299 7991 tablet_bootstrap.cc:492] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da: No bootstrap required, opened a new log
I20260812 11:10:16.500507 7991 ts_tablet_manager.cc:1397] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260812 11:10:16.501380 7991 raft_consensus.cc:348] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.501642 7991 raft_consensus.cc:374] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:16.501729 7991 raft_consensus.cc:729] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dc9801be94a4a2ab46dfde75bd895da, State: Initialized, Role: FOLLOWER
I20260812 11:10:16.502084 7991 consensus_queue.cc:260] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.502748 7991 ts_tablet_manager.cc:1428] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:16.512969 8071 tablet_replica.cc:330] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da: stopping tablet replica
I20260812 11:10:16.513526 8071 raft_consensus.cc:2229] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:16.513939 8071 raft_consensus.cc:2258] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:16.514991 8073 ts_tablet_manager.cc:1918] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:10:16.515228 8073 log.cc:1196] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/95920f0b349e4cb09a73d64b2d18ca43
I20260812 11:10:16.515851 8073 ts_tablet_manager.cc:1939] T 95920f0b349e4cb09a73d64b2d18ca43 P 03231e63bf9f4852a905da2939858da4: Deleting consensus metadata
I20260812 11:10:16.520823 8071 ts_tablet_manager.cc:1905] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:16.522493 7102 catalog_manager.cc:4841] TS 03231e63bf9f4852a905da2939858da4 (127.4.26.65:36111): tablet 95920f0b349e4cb09a73d64b2d18ca43 (table test-table [id=ed332d98347640ddb4776f68fe63a037]) successfully deleted
I20260812 11:10:16.523790 7988 tablet_bootstrap.cc:492] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4: Bootstrap starting.
I20260812 11:10:16.525935 7988 tablet_bootstrap.cc:654] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:16.528752 7988 tablet_bootstrap.cc:492] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4: No bootstrap required, opened a new log
I20260812 11:10:16.528954 7988 ts_tablet_manager.cc:1397] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260812 11:10:16.529860 7988 raft_consensus.cc:348] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.530161 7988 raft_consensus.cc:374] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:16.530282 7988 raft_consensus.cc:729] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03231e63bf9f4852a905da2939858da4, State: Initialized, Role: FOLLOWER
I20260812 11:10:16.530593 7988 consensus_queue.cc:260] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.532124 7988 ts_tablet_manager.cc:1428] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:16.532717 8070 tablet_replica.cc:330] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: stopping tablet replica
I20260812 11:10:16.533243 8070 raft_consensus.cc:2229] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:10:16.534030 8070 raft_consensus.cc:2258] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:16.546936 8070 ts_tablet_manager.cc:1905] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:16.555585 8070 ts_tablet_manager.cc:1918] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:10:16.555954 8070 log.cc:1196] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/95920f0b349e4cb09a73d64b2d18ca43
I20260812 11:10:16.556535 8070 ts_tablet_manager.cc:1939] T 95920f0b349e4cb09a73d64b2d18ca43 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Deleting consensus metadata
I20260812 11:10:16.558616 7099 catalog_manager.cc:4841] TS 9bdcdb72c6f54fc5a3f1313ad76ea1a7 (127.4.26.66:46479): tablet 95920f0b349e4cb09a73d64b2d18ca43 (table test-table [id=ed332d98347640ddb4776f68fe63a037]) successfully deleted
I20260812 11:10:16.567260 8071 ts_tablet_manager.cc:1918] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:10:16.567502 8071 log.cc:1196] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/95920f0b349e4cb09a73d64b2d18ca43
I20260812 11:10:16.568115 8071 ts_tablet_manager.cc:1939] T 95920f0b349e4cb09a73d64b2d18ca43 P 7dc9801be94a4a2ab46dfde75bd895da: Deleting consensus metadata
I20260812 11:10:16.570425 7094 catalog_manager.cc:4841] TS 7dc9801be94a4a2ab46dfde75bd895da (127.4.26.67:43597): tablet 95920f0b349e4cb09a73d64b2d18ca43 (table test-table [id=ed332d98347640ddb4776f68fe63a037]) successfully deleted
I20260812 11:10:16.780678 8067 raft_consensus.cc:482] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:16.780987 8067 raft_consensus.cc:504] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.782039 8067 leader_election.cc:288] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03231e63bf9f4852a905da2939858da4 (127.4.26.65:36111), 7dc9801be94a4a2ab46dfde75bd895da (127.4.26.67:43597)
I20260812 11:10:16.782752 7870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efd19abc7c2744079248f073443b4276" candidate_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc9801be94a4a2ab46dfde75bd895da" is_pre_election: true
I20260812 11:10:16.782802 7382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efd19abc7c2744079248f073443b4276" candidate_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03231e63bf9f4852a905da2939858da4" is_pre_election: true
I20260812 11:10:16.783066 7870 raft_consensus.cc:2454] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdcdb72c6f54fc5a3f1313ad76ea1a7 in term 0.
I20260812 11:10:16.783095 7382 raft_consensus.cc:2454] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdcdb72c6f54fc5a3f1313ad76ea1a7 in term 0.
I20260812 11:10:16.783588 7500 leader_election.cc:302] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dc9801be94a4a2ab46dfde75bd895da, 9bdcdb72c6f54fc5a3f1313ad76ea1a7; no voters:
I20260812 11:10:16.784049 8067 raft_consensus.cc:2781] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:16.784184 8067 raft_consensus.cc:482] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:16.784281 8067 raft_consensus.cc:3037] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:16.787747 8067 raft_consensus.cc:504] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.788614 8067 leader_election.cc:288] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [CANDIDATE]: Term 1 election: Requested vote from peers 03231e63bf9f4852a905da2939858da4 (127.4.26.65:36111), 7dc9801be94a4a2ab46dfde75bd895da (127.4.26.67:43597)
I20260812 11:10:16.789314 7870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efd19abc7c2744079248f073443b4276" candidate_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc9801be94a4a2ab46dfde75bd895da"
I20260812 11:10:16.789316 7382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efd19abc7c2744079248f073443b4276" candidate_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03231e63bf9f4852a905da2939858da4"
I20260812 11:10:16.789547 7870 raft_consensus.cc:3037] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:16.789558 7382 raft_consensus.cc:3037] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:16.791749 7870 raft_consensus.cc:2454] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdcdb72c6f54fc5a3f1313ad76ea1a7 in term 1.
I20260812 11:10:16.792294 7500 leader_election.cc:302] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dc9801be94a4a2ab46dfde75bd895da, 9bdcdb72c6f54fc5a3f1313ad76ea1a7; no voters:
I20260812 11:10:16.792632 8067 raft_consensus.cc:2781] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:16.792693 7382 raft_consensus.cc:2454] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdcdb72c6f54fc5a3f1313ad76ea1a7 in term 1.
I20260812 11:10:16.792807 8067 raft_consensus.cc:686] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 LEADER]: Becoming Leader. State: Replica: 9bdcdb72c6f54fc5a3f1313ad76ea1a7, State: Running, Role: LEADER
I20260812 11:10:16.793473 8067 consensus_queue.cc:237] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:16.796656 7120 catalog_manager.cc:5495] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bdcdb72c6f54fc5a3f1313ad76ea1a7 (127.4.26.66). New cstate: current_term: 1 leader_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260812 11:10:16.834036 7382 raft_consensus.cc:1261] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Refusing update from remote peer 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:16.834389 7870 raft_consensus.cc:1261] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Refusing update from remote peer 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:16.834704 8067 consensus_queue.cc:1035] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:16.834968 7997 consensus_queue.cc:1035] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:16.841190 8043 mvcc.cc:205] Tried to move back new op lower bound from 7317639236944838656 to 7317639236788584448. Current Snapshot: MvccSnapshot[applied={T|T < 7317639236944838656}]
W20260812 11:10:16.863776 8043 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 11:10:18.462136 7119 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:18.462443 7119 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:18.467105 7119 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0: Sending DeleteTablet for 3 replicas of tablet efd19abc7c2744079248f073443b4276
I20260812 11:10:18.468108 7596 tablet_service.cc:1514] Processing DeleteTablet for tablet efd19abc7c2744079248f073443b4276 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:18 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:57296
I20260812 11:10:18.468117 7344 tablet_service.cc:1514] Processing DeleteTablet for tablet efd19abc7c2744079248f073443b4276 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:18 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:60426
I20260812 11:10:18.468132 7841 tablet_service.cc:1514] Processing DeleteTablet for tablet efd19abc7c2744079248f073443b4276 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:18 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:46360
I20260812 11:10:18.483590 8133 tablet_replica.cc:330] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da: stopping tablet replica
I20260812 11:10:18.483829 8127 tablet_replica.cc:330] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4: stopping tablet replica
I20260812 11:10:18.483834 8133 raft_consensus.cc:2229] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:18.484035 8127 raft_consensus.cc:2229] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:18.484083 8133 raft_consensus.cc:2258] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:18.484269 8127 raft_consensus.cc:2258] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:18.484670 8129 tablet_replica.cc:330] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: stopping tablet replica
I20260812 11:10:18.484864 8129 raft_consensus.cc:2229] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:10:18.485241 8129 raft_consensus.cc:2258] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:18.485427 8127 ts_tablet_manager.cc:1905] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:18.486176 8129 ts_tablet_manager.cc:1905] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:18.486176 8133 ts_tablet_manager.cc:1905] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:18.492234 8127 ts_tablet_manager.cc:1918] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:10:18.492411 8127 log.cc:1196] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/efd19abc7c2744079248f073443b4276
I20260812 11:10:18.492853 8127 ts_tablet_manager.cc:1939] T efd19abc7c2744079248f073443b4276 P 03231e63bf9f4852a905da2939858da4: Deleting consensus metadata
I20260812 11:10:18.493359 8129 ts_tablet_manager.cc:1918] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:10:18.493521 8129 log.cc:1196] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/efd19abc7c2744079248f073443b4276
I20260812 11:10:18.493695 8133 ts_tablet_manager.cc:1918] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:10:18.493880 8133 log.cc:1196] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/efd19abc7c2744079248f073443b4276
I20260812 11:10:18.493968 8129 ts_tablet_manager.cc:1939] T efd19abc7c2744079248f073443b4276 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Deleting consensus metadata
I20260812 11:10:18.494258 7102 catalog_manager.cc:4841] TS 03231e63bf9f4852a905da2939858da4 (127.4.26.65:36111): tablet efd19abc7c2744079248f073443b4276 (table test-table [id=dd72fda031a84b4c9188ea8a441a026d]) successfully deleted
I20260812 11:10:18.494479 8133 ts_tablet_manager.cc:1939] T efd19abc7c2744079248f073443b4276 P 7dc9801be94a4a2ab46dfde75bd895da: Deleting consensus metadata
I20260812 11:10:18.495170 7099 catalog_manager.cc:4841] TS 9bdcdb72c6f54fc5a3f1313ad76ea1a7 (127.4.26.66:46479): tablet efd19abc7c2744079248f073443b4276 (table test-table [id=dd72fda031a84b4c9188ea8a441a026d]) successfully deleted
I20260812 11:10:18.495592 7094 catalog_manager.cc:4841] TS 7dc9801be94a4a2ab46dfde75bd895da (127.4.26.67:43597): tablet efd19abc7c2744079248f073443b4276 (table test-table [id=dd72fda031a84b4c9188ea8a441a026d]) successfully deleted
Aug 12 11:10:18 dist-test-slave-rmhg krb5kdc[7047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533018, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:10:18 dist-test-slave-rmhg krb5kdc[7047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533018, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:18.535561 8145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:18.519304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49060 (local address 127.4.26.126:36857)
0812 11:10:18.519969 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:18.519975 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:18.520056 (+ 81us) server_negotiation.cc:407] Connection header received
0812 11:10:18.520312 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:18.520316 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:18.520387 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:18.520485 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:18.522021 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:18.522873 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:18.524235 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:18.524683 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:18.524808 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:18.529276 (+ 4468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:18.529283 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:18.529287 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:18.529334 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:18.532415 (+ 3081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:18.533359 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:18.533365 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:18.533368 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:18.533543 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:18.534012 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:18.534016 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:18.534019 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:18.534341 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:18.534603 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:18.534931 (+ 328us) server_negotiation.cc:299] Negotiation successful
0812 11:10:18.535192 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":332,"threads_started":1}
I20260812 11:10:18.540057 7119 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49060:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:10:18.540810 7119 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:18.548805 7344 tablet_service.cc:1467] Processing CreateTablet for tablet 861d6f9c9c20471994e34c9df69e6790 (DEFAULT_TABLE table=test-table [id=522a91c0eb444c92a91b465b0d224c18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:18.548993 7841 tablet_service.cc:1467] Processing CreateTablet for tablet 861d6f9c9c20471994e34c9df69e6790 (DEFAULT_TABLE table=test-table [id=522a91c0eb444c92a91b465b0d224c18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:18.549041 7596 tablet_service.cc:1467] Processing CreateTablet for tablet 861d6f9c9c20471994e34c9df69e6790 (DEFAULT_TABLE table=test-table [id=522a91c0eb444c92a91b465b0d224c18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:18.549418 7344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 861d6f9c9c20471994e34c9df69e6790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:18.549472 7596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 861d6f9c9c20471994e34c9df69e6790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:18.549520 7841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 861d6f9c9c20471994e34c9df69e6790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:18.556306 8146 tablet_bootstrap.cc:492] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da: Bootstrap starting.
I20260812 11:10:18.557029 8147 tablet_bootstrap.cc:492] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4: Bootstrap starting.
I20260812 11:10:18.558893 8147 tablet_bootstrap.cc:654] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:18.560113 8146 tablet_bootstrap.cc:654] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:18.569291 8146 tablet_bootstrap.cc:492] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da: No bootstrap required, opened a new log
I20260812 11:10:18.569751 8146 ts_tablet_manager.cc:1397] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.000s
I20260812 11:10:18.570978 8146 raft_consensus.cc:348] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.573274 8146 raft_consensus.cc:374] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:18.573556 8146 raft_consensus.cc:729] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dc9801be94a4a2ab46dfde75bd895da, State: Initialized, Role: FOLLOWER
I20260812 11:10:18.574048 8146 consensus_queue.cc:260] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.577801 8151 tablet_bootstrap.cc:492] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Bootstrap starting.
I20260812 11:10:18.579802 8151 tablet_bootstrap.cc:654] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:18.580039 8147 tablet_bootstrap.cc:492] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4: No bootstrap required, opened a new log
I20260812 11:10:18.580211 8147 ts_tablet_manager.cc:1397] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.011s
I20260812 11:10:18.580993 8147 raft_consensus.cc:348] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.581305 8147 raft_consensus.cc:374] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:18.581410 8147 raft_consensus.cc:729] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03231e63bf9f4852a905da2939858da4, State: Initialized, Role: FOLLOWER
I20260812 11:10:18.581781 8147 consensus_queue.cc:260] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.582520 8147 ts_tablet_manager.cc:1428] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:18.582533 8151 tablet_bootstrap.cc:492] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: No bootstrap required, opened a new log
I20260812 11:10:18.582700 8151 ts_tablet_manager.cc:1397] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260812 11:10:18.583537 8151 raft_consensus.cc:348] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.583802 8151 raft_consensus.cc:374] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:18.583886 8151 raft_consensus.cc:729] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdcdb72c6f54fc5a3f1313ad76ea1a7, State: Initialized, Role: FOLLOWER
I20260812 11:10:18.584157 8151 consensus_queue.cc:260] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.584877 8151 ts_tablet_manager.cc:1428] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:18.585299 8146 ts_tablet_manager.cc:1428] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da: Time spent starting tablet: real 0.015s user 0.000s sys 0.009s
I20260812 11:10:18.636840 8006 raft_consensus.cc:482] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:18.637095 8006 raft_consensus.cc:504] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.637831 8006 leader_election.cc:288] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03231e63bf9f4852a905da2939858da4 (127.4.26.65:36111), 7dc9801be94a4a2ab46dfde75bd895da (127.4.26.67:43597)
I20260812 11:10:18.638444 7870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "861d6f9c9c20471994e34c9df69e6790" candidate_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc9801be94a4a2ab46dfde75bd895da" is_pre_election: true
I20260812 11:10:18.638471 7377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "861d6f9c9c20471994e34c9df69e6790" candidate_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03231e63bf9f4852a905da2939858da4" is_pre_election: true
I20260812 11:10:18.638670 7870 raft_consensus.cc:2454] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdcdb72c6f54fc5a3f1313ad76ea1a7 in term 0.
I20260812 11:10:18.638705 7377 raft_consensus.cc:2454] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdcdb72c6f54fc5a3f1313ad76ea1a7 in term 0.
I20260812 11:10:18.639160 7500 leader_election.cc:302] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 03231e63bf9f4852a905da2939858da4, 7dc9801be94a4a2ab46dfde75bd895da, 9bdcdb72c6f54fc5a3f1313ad76ea1a7; no voters:
I20260812 11:10:18.639479 8006 raft_consensus.cc:2781] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:18.639631 8006 raft_consensus.cc:482] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:18.639719 8006 raft_consensus.cc:3037] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:18.641870 8006 raft_consensus.cc:504] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.642484 8006 leader_election.cc:288] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [CANDIDATE]: Term 1 election: Requested vote from peers 03231e63bf9f4852a905da2939858da4 (127.4.26.65:36111), 7dc9801be94a4a2ab46dfde75bd895da (127.4.26.67:43597)
I20260812 11:10:18.643138 7377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "861d6f9c9c20471994e34c9df69e6790" candidate_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03231e63bf9f4852a905da2939858da4"
I20260812 11:10:18.643251 7870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "861d6f9c9c20471994e34c9df69e6790" candidate_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc9801be94a4a2ab46dfde75bd895da"
I20260812 11:10:18.643353 7377 raft_consensus.cc:3037] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:18.643646 7870 raft_consensus.cc:3037] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:18.645851 7377 raft_consensus.cc:2454] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdcdb72c6f54fc5a3f1313ad76ea1a7 in term 1.
I20260812 11:10:18.646010 7870 raft_consensus.cc:2454] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdcdb72c6f54fc5a3f1313ad76ea1a7 in term 1.
I20260812 11:10:18.646417 7505 leader_election.cc:302] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03231e63bf9f4852a905da2939858da4, 9bdcdb72c6f54fc5a3f1313ad76ea1a7; no voters:
I20260812 11:10:18.646950 8006 raft_consensus.cc:2781] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:18.647120 8006 raft_consensus.cc:686] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 LEADER]: Becoming Leader. State: Replica: 9bdcdb72c6f54fc5a3f1313ad76ea1a7, State: Running, Role: LEADER
I20260812 11:10:18.647395 8006 consensus_queue.cc:237] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.650444 7117 catalog_manager.cc:5495] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bdcdb72c6f54fc5a3f1313ad76ea1a7 (127.4.26.66). New cstate: current_term: 1 leader_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260812 11:10:18.678468 8163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:18.672862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57316 (local address 127.4.26.66:46479)
0812 11:10:18.673482 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:18.673487 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:18.673508 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:10:18.673569 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:18.673573 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:18.673639 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:18.673730 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:18.674161 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:18.674997 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:18.676416 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:18.676877 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:18.676988 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:18.677532 (+ 544us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:18.677668 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:18.677750 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:18.678055 (+ 305us) server_negotiation.cc:299] Negotiation successful
0812 11:10:18.678134 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":346,"threads_started":1}
I20260812 11:10:18.688393 7870 raft_consensus.cc:1261] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Refusing update from remote peer 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:18.688434 7377 raft_consensus.cc:1261] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Refusing update from remote peer 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:18.688979 8114 consensus_queue.cc:1035] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:18.689378 8006 consensus_queue.cc:1035] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:18.698211 8094 mvcc.cc:205] Tried to move back new op lower bound from 7317639244542664704 to 7317639244382167040. Current Snapshot: MvccSnapshot[applied={T|T < 7317639244542664704}]
I20260812 11:10:18.741561 7119 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49060:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:18.741809 7119 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49060:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:18.745189 7119 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0: Sending DeleteTablet for 3 replicas of tablet 861d6f9c9c20471994e34c9df69e6790
I20260812 11:10:18.746232 7344 tablet_service.cc:1514] Processing DeleteTablet for tablet 861d6f9c9c20471994e34c9df69e6790 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:18 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:60426
I20260812 11:10:18.746234 7841 tablet_service.cc:1514] Processing DeleteTablet for tablet 861d6f9c9c20471994e34c9df69e6790 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:18 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:46360
I20260812 11:10:18.746295 7596 tablet_service.cc:1514] Processing DeleteTablet for tablet 861d6f9c9c20471994e34c9df69e6790 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:18 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:57296
I20260812 11:10:18.746553 8133 tablet_replica.cc:330] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da: stopping tablet replica
I20260812 11:10:18.746598 8129 tablet_replica.cc:330] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: stopping tablet replica
I20260812 11:10:18.746759 8133 raft_consensus.cc:2229] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:18.746958 8129 raft_consensus.cc:2229] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:10:18.746973 8133 raft_consensus.cc:2258] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:18.747310 8129 raft_consensus.cc:2258] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:18.747504 8127 tablet_replica.cc:330] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4: stopping tablet replica
I20260812 11:10:18.747781 8127 raft_consensus.cc:2229] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:18.748020 8127 raft_consensus.cc:2258] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:18.748283 8133 ts_tablet_manager.cc:1905] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:18.748183 7119 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49060:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 11:10:18.748528 8129 ts_tablet_manager.cc:1905] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 11:10:18.749177 7119 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:18.749189 8127 ts_tablet_manager.cc:1905] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:18.755600 8129 ts_tablet_manager.cc:1918] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:10:18.755798 8129 log.cc:1196] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/861d6f9c9c20471994e34c9df69e6790
I20260812 11:10:18.756199 8129 ts_tablet_manager.cc:1939] T 861d6f9c9c20471994e34c9df69e6790 P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Deleting consensus metadata
I20260812 11:10:18.756803 8127 ts_tablet_manager.cc:1918] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:10:18.756981 8127 log.cc:1196] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/861d6f9c9c20471994e34c9df69e6790
I20260812 11:10:18.757357 8133 ts_tablet_manager.cc:1918] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:10:18.757472 8127 ts_tablet_manager.cc:1939] T 861d6f9c9c20471994e34c9df69e6790 P 03231e63bf9f4852a905da2939858da4: Deleting consensus metadata
I20260812 11:10:18.757660 7841 tablet_service.cc:1467] Processing CreateTablet for tablet a5d902b42ceb49668a7ef7c38e097a7f (DEFAULT_TABLE table=test-table [id=1666056b28e34eb090f4ee4f1c793c7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:18.758140 7841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5d902b42ceb49668a7ef7c38e097a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:18.758641 7102 catalog_manager.cc:4841] TS 03231e63bf9f4852a905da2939858da4 (127.4.26.65:36111): tablet 861d6f9c9c20471994e34c9df69e6790 (table test-table [id=522a91c0eb444c92a91b465b0d224c18]) successfully deleted
I20260812 11:10:18.758788 7344 tablet_service.cc:1467] Processing CreateTablet for tablet a5d902b42ceb49668a7ef7c38e097a7f (DEFAULT_TABLE table=test-table [id=1666056b28e34eb090f4ee4f1c793c7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:18.758889 7099 catalog_manager.cc:4841] TS 9bdcdb72c6f54fc5a3f1313ad76ea1a7 (127.4.26.66:46479): tablet 861d6f9c9c20471994e34c9df69e6790 (table test-table [id=522a91c0eb444c92a91b465b0d224c18]) successfully deleted
I20260812 11:10:18.759225 7344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5d902b42ceb49668a7ef7c38e097a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:18.759922 7596 tablet_service.cc:1467] Processing CreateTablet for tablet a5d902b42ceb49668a7ef7c38e097a7f (DEFAULT_TABLE table=test-table [id=1666056b28e34eb090f4ee4f1c793c7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:18.760401 7596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5d902b42ceb49668a7ef7c38e097a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:18.764478 8146 tablet_bootstrap.cc:492] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da: Bootstrap starting.
I20260812 11:10:18.757660 8133 log.cc:1196] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/861d6f9c9c20471994e34c9df69e6790
I20260812 11:10:18.765635 8133 ts_tablet_manager.cc:1939] T 861d6f9c9c20471994e34c9df69e6790 P 7dc9801be94a4a2ab46dfde75bd895da: Deleting consensus metadata
I20260812 11:10:18.766408 8146 tablet_bootstrap.cc:654] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:18.766837 8147 tablet_bootstrap.cc:492] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4: Bootstrap starting.
I20260812 11:10:18.767481 7094 catalog_manager.cc:4841] TS 7dc9801be94a4a2ab46dfde75bd895da (127.4.26.67:43597): tablet 861d6f9c9c20471994e34c9df69e6790 (table test-table [id=522a91c0eb444c92a91b465b0d224c18]) successfully deleted
I20260812 11:10:18.767982 8151 tablet_bootstrap.cc:492] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Bootstrap starting.
I20260812 11:10:18.768567 8147 tablet_bootstrap.cc:654] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:18.769922 8151 tablet_bootstrap.cc:654] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:18.770753 8146 tablet_bootstrap.cc:492] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da: No bootstrap required, opened a new log
I20260812 11:10:18.770984 8146 ts_tablet_manager.cc:1397] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260812 11:10:18.771847 8146 raft_consensus.cc:348] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.772140 8146 raft_consensus.cc:374] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:18.772234 8146 raft_consensus.cc:729] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dc9801be94a4a2ab46dfde75bd895da, State: Initialized, Role: FOLLOWER
I20260812 11:10:18.772244 8147 tablet_bootstrap.cc:492] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4: No bootstrap required, opened a new log
I20260812 11:10:18.772420 8147 ts_tablet_manager.cc:1397] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260812 11:10:18.772498 8146 consensus_queue.cc:260] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.773140 8146 ts_tablet_manager.cc:1428] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260812 11:10:18.773348 8147 raft_consensus.cc:348] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.773677 8147 raft_consensus.cc:374] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:18.773772 8147 raft_consensus.cc:729] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03231e63bf9f4852a905da2939858da4, State: Initialized, Role: FOLLOWER
I20260812 11:10:18.774025 8147 consensus_queue.cc:260] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.774475 8147 ts_tablet_manager.cc:1428] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:18.775604 8151 tablet_bootstrap.cc:492] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: No bootstrap required, opened a new log
I20260812 11:10:18.775825 8151 ts_tablet_manager.cc:1397] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.003s
I20260812 11:10:18.776762 8151 raft_consensus.cc:348] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.777029 8151 raft_consensus.cc:374] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:18.777119 8151 raft_consensus.cc:729] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bdcdb72c6f54fc5a3f1313ad76ea1a7, State: Initialized, Role: FOLLOWER
I20260812 11:10:18.777524 8151 consensus_queue.cc:260] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.778244 8151 ts_tablet_manager.cc:1428] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260812 11:10:18.930279 8104 raft_consensus.cc:482] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:18.930539 8104 raft_consensus.cc:504] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.931427 8104 leader_election.cc:288] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03231e63bf9f4852a905da2939858da4 (127.4.26.65:36111), 7dc9801be94a4a2ab46dfde75bd895da (127.4.26.67:43597)
I20260812 11:10:18.932013 7871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5d902b42ceb49668a7ef7c38e097a7f" candidate_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc9801be94a4a2ab46dfde75bd895da" is_pre_election: true
I20260812 11:10:18.932029 7377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5d902b42ceb49668a7ef7c38e097a7f" candidate_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03231e63bf9f4852a905da2939858da4" is_pre_election: true
I20260812 11:10:18.932271 7377 raft_consensus.cc:2454] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdcdb72c6f54fc5a3f1313ad76ea1a7 in term 0.
I20260812 11:10:18.932281 7871 raft_consensus.cc:2454] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bdcdb72c6f54fc5a3f1313ad76ea1a7 in term 0.
I20260812 11:10:18.932767 7505 leader_election.cc:302] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 03231e63bf9f4852a905da2939858da4, 7dc9801be94a4a2ab46dfde75bd895da, 9bdcdb72c6f54fc5a3f1313ad76ea1a7; no voters:
I20260812 11:10:18.933081 8104 raft_consensus.cc:2781] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:18.933233 8104 raft_consensus.cc:482] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:18.933312 8104 raft_consensus.cc:3037] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:18.935441 8104 raft_consensus.cc:504] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.936071 8104 leader_election.cc:288] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [CANDIDATE]: Term 1 election: Requested vote from peers 03231e63bf9f4852a905da2939858da4 (127.4.26.65:36111), 7dc9801be94a4a2ab46dfde75bd895da (127.4.26.67:43597)
I20260812 11:10:18.936659 7871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5d902b42ceb49668a7ef7c38e097a7f" candidate_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc9801be94a4a2ab46dfde75bd895da"
I20260812 11:10:18.936733 7377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5d902b42ceb49668a7ef7c38e097a7f" candidate_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03231e63bf9f4852a905da2939858da4"
I20260812 11:10:18.936901 7871 raft_consensus.cc:3037] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:18.937000 7377 raft_consensus.cc:3037] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:18.939270 7871 raft_consensus.cc:2454] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdcdb72c6f54fc5a3f1313ad76ea1a7 in term 1.
I20260812 11:10:18.939380 7377 raft_consensus.cc:2454] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bdcdb72c6f54fc5a3f1313ad76ea1a7 in term 1.
I20260812 11:10:18.939812 7500 leader_election.cc:302] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dc9801be94a4a2ab46dfde75bd895da, 9bdcdb72c6f54fc5a3f1313ad76ea1a7; no voters:
I20260812 11:10:18.940264 8104 raft_consensus.cc:2781] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:18.940428 8104 raft_consensus.cc:686] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 LEADER]: Becoming Leader. State: Replica: 9bdcdb72c6f54fc5a3f1313ad76ea1a7, State: Running, Role: LEADER
I20260812 11:10:18.940737 8104 consensus_queue.cc:237] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } }
I20260812 11:10:18.943943 7117 catalog_manager.cc:5495] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bdcdb72c6f54fc5a3f1313ad76ea1a7 (127.4.26.66). New cstate: current_term: 1 leader_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bdcdb72c6f54fc5a3f1313ad76ea1a7" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260812 11:10:18.995838 7377 raft_consensus.cc:1261] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Refusing update from remote peer 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:18.995877 7871 raft_consensus.cc:1261] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Refusing update from remote peer 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:18.996434 8104 consensus_queue.cc:1035] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03231e63bf9f4852a905da2939858da4" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:18.996809 8114 consensus_queue.cc:1035] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dc9801be94a4a2ab46dfde75bd895da" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:10:19.021729 8096 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260812 11:10:20.621018 7119 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49060:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:20.621335 7119 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49060:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:20.626070 7119 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4ca7ee32de66492888329cd0ca9048c0: Sending DeleteTablet for 3 replicas of tablet a5d902b42ceb49668a7ef7c38e097a7f
I20260812 11:10:20.627022 7344 tablet_service.cc:1514] Processing DeleteTablet for tablet a5d902b42ceb49668a7ef7c38e097a7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:20 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:60426
I20260812 11:10:20.627300 7596 tablet_service.cc:1514] Processing DeleteTablet for tablet a5d902b42ceb49668a7ef7c38e097a7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:20 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:57296
I20260812 11:10:20.627799 8228 tablet_replica.cc:330] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4: stopping tablet replica
I20260812 11:10:20.627779 7841 tablet_service.cc:1514] Processing DeleteTablet for tablet a5d902b42ceb49668a7ef7c38e097a7f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:20 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:46360
I20260812 11:10:20.627923 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 7234
I20260812 11:10:20.628000 8228 raft_consensus.cc:2229] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:20.628265 8228 raft_consensus.cc:2258] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:20.630213 8231 tablet_replica.cc:330] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: stopping tablet replica
I20260812 11:10:20.630429 8231 raft_consensus.cc:2229] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:10:20.630862 8231 raft_consensus.cc:2258] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:20.631785 8231 ts_tablet_manager.cc:1905] T a5d902b42ceb49668a7ef7c38e097a7f P 9bdcdb72c6f54fc5a3f1313ad76ea1a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:20.633937 8228 ts_tablet_manager.cc:1905] T a5d902b42ceb49668a7ef7c38e097a7f P 03231e63bf9f4852a905da2939858da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:20.635634 8233 tablet_replica.cc:330] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da: stopping tablet replica
I20260812 11:10:20.635891 8233 raft_consensus.cc:2229] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:20.636178 8233 raft_consensus.cc:2258] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:20.637356 8233 ts_tablet_manager.cc:1905] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 11:10:20 dist-test-slave-rmhg krb5kdc[7047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533018, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:10:20.657704 8236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.629379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59254 (local address 127.4.26.65:36111)
0812 11:10:20.635145 (+ 5766us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:20.635151 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:20.636140 (+ 989us) server_negotiation.cc:407] Connection header received
0812 11:10:20.636382 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:20.636388 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:20.636502 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:20.636639 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:20.638502 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.639669 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.641180 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.641642 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.641770 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.650818 (+ 9048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:20.650837 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:20.650858 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:20.650926 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:20.654277 (+ 3351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:20.655271 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:20.655281 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:20.655283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:20.655497 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:20.656044 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:20.656049 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:20.656051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:20.656555 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:20.656819 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:20.657108 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 11:10:20.657358 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5599,"thread_start_us":5513,"threads_started":1}
W20260812 11:10:20.658521 7460 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59254
W20260812 11:10:20.659474 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 7234: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:10:20.659657 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 7234
I20260812 11:10:20.701460 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 7471
W20260812 11:10:20.701606 7102 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.26.65:36111 (error 108)
I20260812 11:10:20.704730 8240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.703580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:36111 (local address 127.0.0.1:59270)
0812 11:10:20.704125 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:20.704382 (+ 257us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:36111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":232,"threads_started":1}
W20260812 11:10:20.705039 7102 catalog_manager.cc:4584] TS 03231e63bf9f4852a905da2939858da4 (127.4.26.65:36111): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a5d902b42ceb49668a7ef7c38e097a7f: Network error: Client connection negotiation failed: client connection to 127.4.26.65:36111: connect: Connection refused (error 111)
Aug 12 11:10:20 dist-test-slave-rmhg krb5kdc[7047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533018, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:10:20.722098 8239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.702392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43910 (local address 127.4.26.66:46479)
0812 11:10:20.703034 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:20.703041 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:20.703062 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:10:20.703132 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:20.703136 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:20.703207 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:20.703312 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:20.705613 (+ 2301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.706440 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.707791 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.708347 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.708562 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.715320 (+ 6758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:20.715340 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:20.715360 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:20.715408 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:20.718633 (+ 3225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:20.719672 (+ 1039us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:20.719681 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:20.719683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:20.719840 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:20.720308 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:20.720314 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:20.720316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:20.720775 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:20.721047 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:20.721505 (+ 458us) server_negotiation.cc:299] Negotiation successful
0812 11:10:20.721767 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":328,"threads_started":1}
W20260812 11:10:20.722862 7705 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43910
W20260812 11:10:20.723596 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 7471: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:10:20.723816 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 7471
I20260812 11:10:20.759150 8240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.758577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:36111 (local address 127.0.0.1:59276)
0812 11:10:20.758816 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:20.758946 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:36111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260812 11:10:20.760632 8240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.760059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:36111 (local address 127.0.0.1:59288)
0812 11:10:20.760324 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:20.760449 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:36111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 11:10:20.761865 8233 ts_tablet_manager.cc:1918] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260812 11:10:20.762122 8233 log.cc:1196] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/a5d902b42ceb49668a7ef7c38e097a7f
I20260812 11:10:20.762620 8233 ts_tablet_manager.cc:1939] T a5d902b42ceb49668a7ef7c38e097a7f P 7dc9801be94a4a2ab46dfde75bd895da: Deleting consensus metadata
I20260812 11:10:20.770150 7094 catalog_manager.cc:4841] TS 7dc9801be94a4a2ab46dfde75bd895da (127.4.26.67:43597): tablet a5d902b42ceb49668a7ef7c38e097a7f (table test-table [id=1666056b28e34eb090f4ee4f1c793c7b]) successfully deleted
I20260812 11:10:20.785462 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 7722
I20260812 11:10:20.786253 8240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.785764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:46479 (local address 127.0.0.1:43924)
0812 11:10:20.785948 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:20.786045 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.66:46479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
Aug 12 11:10:20 dist-test-slave-rmhg krb5kdc[7047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533018, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:10:20.805233 8243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.786317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58090 (local address 127.4.26.67:43597)
0812 11:10:20.786890 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:20.786897 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:20.786914 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:10:20.786968 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:20.786973 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:20.787035 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:20.787144 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:20.788553 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.789422 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.790863 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:20.791355 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:20.791481 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:20.797188 (+ 5707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:20.797216 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:20.797239 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:20.797301 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:20.801072 (+ 3771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:20.802261 (+ 1189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:20.802272 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:20.802275 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:20.802473 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:20.803196 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:20.803202 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:20.803204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:20.803738 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:20.804158 (+ 420us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:20.804648 (+ 490us) server_negotiation.cc:299] Negotiation successful
0812 11:10:20.804871 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":254,"threads_started":1}
W20260812 11:10:20.806113 7943 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58090
W20260812 11:10:20.806809 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 7722: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:10:20.807003 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 7722
I20260812 11:10:20.822242 8240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.821689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:46479 (local address 127.0.0.1:43926)
0812 11:10:20.821960 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:20.822060 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.66:46479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162}
I20260812 11:10:20.822988 8240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.821707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:36111 (local address 127.0.0.1:59294)
0812 11:10:20.822766 (+ 1059us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:20.822852 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:36111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":952,"mutex_wait_us":794}
I20260812 11:10:20.824381 8240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.823885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:46479 (local address 127.0.0.1:43934)
0812 11:10:20.824114 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:20.824198 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.66:46479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132}
I20260812 11:10:20.824826 8240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.823945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:36111 (local address 127.0.0.1:59302)
0812 11:10:20.824607 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:20.824693 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:36111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":567,"threads_started":1}
I20260812 11:10:20.844877 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 7066
I20260812 11:10:20.846241 7186 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:20.968840 8240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:20.968299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:46479 (local address 127.0.0.1:43936)
0812 11:10:20.968468 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:20.968608 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.66:46479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 11:10:20.968990 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 7066
2026-08-12T11:10:20Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9212 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:21 dist-test-slave-rmhg krb5kdc[8248](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:21 dist-test-slave-rmhg krb5kdc[8248](info): set up 2 sockets
Aug 12 11:10:21 dist-test-slave-rmhg krb5kdc[8248](info): commencing operation
krb5kdc: starting...
W20260812 11:10:22.974968 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.952s user 0.001s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:10:23 dist-test-slave-rmhg krb5kdc[8248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:10:23.205664 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37419
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:33091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:37419
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:23.567446 8266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:23.567832 8266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:23.567974 8266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:23.575802 8266 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:23.575976 8266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:23.576139 8266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:23.576321 8266 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:23.576400 8266 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:23.587577 8266 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:33091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:37419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:23.589241 8266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:23.590777 8266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:23.603678 8272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:23.603642 8276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:23.603722 8274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:23.605098 8266 server_base.cc:1034] running on GCE node
I20260812 11:10:23.606125 8266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:23.607858 8266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:23.609203 8266 hybrid_clock.cc:648] HybridClock initialized: now 1786533023609080 us; error 77 us; skew 500 ppm
I20260812 11:10:23.609670 8266 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:23 dist-test-slave-rmhg krb5kdc[8248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533023, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:23.613585 8266 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:10:23.615409 8266 webserver.cc:460] Webserver started at http://127.4.26.126:37085/ using document root <none> and password file <none>
I20260812 11:10:23.616212 8266 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:23.616340 8266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:23.616703 8266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:23.620086 8266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "1889c68f27964b6586eea63ceaafcb1f"
format_stamp: "Formatted at 2026-08-12 11:10:23 on dist-test-slave-rmhg"
server_key: "d99d3a0df4d08926d94e5fd01bff465a"
server_key_iv: "e3e1b2383cb30907a307636e5ec64673"
server_key_version: "encryptionkey@0"
I20260812 11:10:23.621034 8266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "1889c68f27964b6586eea63ceaafcb1f"
format_stamp: "Formatted at 2026-08-12 11:10:23 on dist-test-slave-rmhg"
server_key: "d99d3a0df4d08926d94e5fd01bff465a"
server_key_iv: "e3e1b2383cb30907a307636e5ec64673"
server_key_version: "encryptionkey@0"
I20260812 11:10:23.627197 8266 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260812 11:10:23.631399 8286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:23.633071 8266 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:10:23.633342 8266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "1889c68f27964b6586eea63ceaafcb1f"
format_stamp: "Formatted at 2026-08-12 11:10:23 on dist-test-slave-rmhg"
server_key: "d99d3a0df4d08926d94e5fd01bff465a"
server_key_iv: "e3e1b2383cb30907a307636e5ec64673"
server_key_version: "encryptionkey@0"
I20260812 11:10:23.633563 8266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:23.650312 8266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:23.655608 8266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:23.655934 8266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:23.676784 8266 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:37419
I20260812 11:10:23.676852 8371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:37419 every 8 connection(s)
I20260812 11:10:23.678380 8266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:23.680202 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 8266
I20260812 11:10:23.680452 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:10:23.681339 4201 external_mini_cluster.cc:1428] Setting key f3b71027defaa30cf36475fa31d56c70
I20260812 11:10:23.683694 8374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 11:10:23 dist-test-slave-rmhg krb5kdc[8248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:23.696411 8374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f: Bootstrap starting.
I20260812 11:10:23.700119 8374 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:23.701287 8374 log.cc:824] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:23.704586 8374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f: No bootstrap required, opened a new log
I20260812 11:10:23.705633 8380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:23.683777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49610 (local address 127.4.26.126:37419)
0812 11:10:23.684688 (+ 911us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:23.684702 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:23.684752 (+ 50us) server_negotiation.cc:407] Connection header received
0812 11:10:23.686487 (+ 1735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:23.686516 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:23.686983 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:23.687421 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:23.689051 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:23.690577 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:23.691961 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:23.692755 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:23.692987 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:23.697552 (+ 4565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:23.697563 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:23.697581 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:23.697631 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:23.700903 (+ 3272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:23.701786 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:23.701801 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:23.701812 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:23.702082 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:23.702583 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:23.702588 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:23.702591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:23.703220 (+ 629us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:23.703529 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:23.704016 (+ 487us) server_negotiation.cc:299] Negotiation successful
0812 11:10:23.704501 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":634,"thread_start_us":373,"threads_started":1}
I20260812 11:10:23.713079 8374 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1889c68f27964b6586eea63ceaafcb1f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37419 } }
I20260812 11:10:23.713645 8374 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:23.713757 8374 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1889c68f27964b6586eea63ceaafcb1f, State: Initialized, Role: FOLLOWER
I20260812 11:10:23.714443 8374 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1889c68f27964b6586eea63ceaafcb1f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37419 } }
I20260812 11:10:23.714704 8374 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:23.714846 8374 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:23.715014 8374 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:23.717593 8374 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1889c68f27964b6586eea63ceaafcb1f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37419 } }
I20260812 11:10:23.718142 8374 leader_election.cc:302] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1889c68f27964b6586eea63ceaafcb1f; no voters:
I20260812 11:10:23.718750 8374 leader_election.cc:288] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:23.718896 8384 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:23.719604 8384 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [term 1 LEADER]: Becoming Leader. State: Replica: 1889c68f27964b6586eea63ceaafcb1f, State: Running, Role: LEADER
I20260812 11:10:23.720244 8384 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1889c68f27964b6586eea63ceaafcb1f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37419 } }
I20260812 11:10:23.720929 8374 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:23.723043 8386 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1889c68f27964b6586eea63ceaafcb1f. Latest consensus state: current_term: 1 leader_uuid: "1889c68f27964b6586eea63ceaafcb1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1889c68f27964b6586eea63ceaafcb1f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37419 } } }
I20260812 11:10:23.723471 8386 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:23.724920 8392 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:23.724701 8385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1889c68f27964b6586eea63ceaafcb1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1889c68f27964b6586eea63ceaafcb1f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37419 } } }
I20260812 11:10:23.725921 8385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:23.731674 8392 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:23.742211 8392 catalog_manager.cc:1347] Generated new cluster ID: fade55f5902b453696623dc28fb62e93
I20260812 11:10:23.742342 8392 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:23.763051 8392 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:23.765528 8392 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:23.773428 8392 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1889c68f27964b6586eea63ceaafcb1f: Generated new TSK 0
I20260812 11:10:23.774719 8392 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:10:23.833106 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37419
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:33091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:24.189915 8411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:24.190264 8411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:24.190404 8411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:24.197815 8411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:24.197964 8411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:24.198123 8411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:10:24.209285 8411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:33091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37419
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:24.210757 8411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:24.212252 8411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:24.226840 8419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:24.226912 8418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:24.226934 8422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:24.228140 8411 server_base.cc:1034] running on GCE node
I20260812 11:10:24.228852 8411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:24.229959 8411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:24.231218 8411 hybrid_clock.cc:648] HybridClock initialized: now 1786533024231152 us; error 53 us; skew 500 ppm
I20260812 11:10:24.231580 8411 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:24 dist-test-slave-rmhg krb5kdc[8248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533024, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:24.235229 8411 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:10:24.236861 8411 webserver.cc:460] Webserver started at http://127.4.26.65:45381/ using document root <none> and password file <none>
I20260812 11:10:24.237668 8411 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:24.237821 8411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:24.238221 8411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:24.241503 8411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "629bd185e35740f390e6853a452d6628"
format_stamp: "Formatted at 2026-08-12 11:10:24 on dist-test-slave-rmhg"
server_key: "3893b0ab294323ad1cc2749d46d8f5a2"
server_key_iv: "22d1b0884440282485073bd6471a8342"
server_key_version: "encryptionkey@0"
I20260812 11:10:24.242411 8411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "629bd185e35740f390e6853a452d6628"
format_stamp: "Formatted at 2026-08-12 11:10:24 on dist-test-slave-rmhg"
server_key: "3893b0ab294323ad1cc2749d46d8f5a2"
server_key_iv: "22d1b0884440282485073bd6471a8342"
server_key_version: "encryptionkey@0"
I20260812 11:10:24.248333 8411 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260812 11:10:24.252354 8431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:24.254123 8411 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:24.254330 8411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "629bd185e35740f390e6853a452d6628"
format_stamp: "Formatted at 2026-08-12 11:10:24 on dist-test-slave-rmhg"
server_key: "3893b0ab294323ad1cc2749d46d8f5a2"
server_key_iv: "22d1b0884440282485073bd6471a8342"
server_key_version: "encryptionkey@0"
I20260812 11:10:24.254559 8411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:24.276252 8411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:24.281255 8411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:24.281581 8411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:24.282694 8411 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:24.284282 8411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:24.284368 8411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:24.284526 8411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:24.284584 8411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:24.319460 8411 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:35041
I20260812 11:10:24.319528 8644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:35041 every 8 connection(s)
I20260812 11:10:24.320878 8411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:24.328459 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 8411
I20260812 11:10:24.328723 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:24.329548 4201 external_mini_cluster.cc:1428] Setting key 12b99a810369098736e85eb76cf2df88
Aug 12 11:10:24 dist-test-slave-rmhg krb5kdc[8248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533024, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:24.345996 8648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:24.323856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:55143 (local address 127.4.26.126:37419)
0812 11:10:24.324350 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:24.324356 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:24.325643 (+ 1287us) server_negotiation.cc:407] Connection header received
0812 11:10:24.327687 (+ 2044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:24.327692 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:24.327792 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:24.327901 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:24.330382 (+ 2481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:24.331205 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:24.333581 (+ 2376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:24.334030 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:24.334150 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:24.338756 (+ 4606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:24.338762 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:24.338766 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:24.338807 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:24.341845 (+ 3038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:24.343010 (+ 1165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:24.343017 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:24.343019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:24.343176 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:24.343814 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:24.343819 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:24.343821 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:24.344167 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:24.344316 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:24.345422 (+ 1106us) server_negotiation.cc:299] Negotiation successful
0812 11:10:24.345699 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":241,"threads_started":1}
I20260812 11:10:24.347407 8649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:24.324578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37419 (local address 127.4.26.65:55143)
0812 11:10:24.325449 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:24.325503 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:24.327318 (+ 1815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:24.328270 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:24.328283 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:24.329188 (+ 905us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:24.330115 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:24.330146 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:24.331407 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:24.331411 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:24.333350 (+ 1939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:24.333371 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:24.334307 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:24.334314 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:24.334623 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:24.335433 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:24.335473 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:24.338433 (+ 2960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:24.342059 (+ 3626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:24.342071 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:24.342093 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:24.342803 (+ 710us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:24.343323 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:24.343328 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:24.343331 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:24.343637 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:24.344325 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:24.344334 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:24.344903 (+ 569us) client_negotiation.cc:769] Sending connection context
0812 11:10:24.345258 (+ 355us) client_negotiation.cc:240] Negotiation successful
0812 11:10:24.345870 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":317,"threads_started":1}
I20260812 11:10:24.349344 8645 heartbeater.cc:347] Connected to a master server at 127.4.26.126:37419
I20260812 11:10:24.349686 8645 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:24.350481 8645 heartbeater.cc:511] Master 127.4.26.126:37419 requested a full tablet report, sending...
I20260812 11:10:24.353185 8313 ts_manager.cc:194] Registered new tserver with Master: 629bd185e35740f390e6853a452d6628 (127.4.26.65:35041)
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
I20260812 11:10:24.354946 8313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:55143
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:10:24.384447 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37419
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:33091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:24.740800 8652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:24.741133 8652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:24.741298 8652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:24.749416 8652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:24.749579 8652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:24.749749 8652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:10:24.760330 8652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:33091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37419
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:24.761826 8652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:24.763218 8652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:24.777277 8659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:24.777237 8664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:24.777300 8662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:24.778470 8652 server_base.cc:1034] running on GCE node
I20260812 11:10:24.779215 8652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:24.780325 8652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:24.781594 8652 hybrid_clock.cc:648] HybridClock initialized: now 1786533024781486 us; error 58 us; skew 500 ppm
I20260812 11:10:24.781972 8652 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:24 dist-test-slave-rmhg krb5kdc[8248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533024, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:24.785588 8652 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:10:24.787256 8652 webserver.cc:460] Webserver started at http://127.4.26.66:44179/ using document root <none> and password file <none>
I20260812 11:10:24.788038 8652 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:24.788175 8652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:24.788506 8652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:24.791778 8652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "2cbd80efd87a4a9e98316a6c098ae7da"
format_stamp: "Formatted at 2026-08-12 11:10:24 on dist-test-slave-rmhg"
server_key: "9a1dc43d5ffd993510ca34f4fc8f38f8"
server_key_iv: "4a5d11529bf3e0d7158cc415dd6b3120"
server_key_version: "encryptionkey@0"
I20260812 11:10:24.792652 8652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "2cbd80efd87a4a9e98316a6c098ae7da"
format_stamp: "Formatted at 2026-08-12 11:10:24 on dist-test-slave-rmhg"
server_key: "9a1dc43d5ffd993510ca34f4fc8f38f8"
server_key_iv: "4a5d11529bf3e0d7158cc415dd6b3120"
server_key_version: "encryptionkey@0"
I20260812 11:10:24.798951 8652 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260812 11:10:24.803370 8675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:24.805262 8652 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260812 11:10:24.805469 8652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "2cbd80efd87a4a9e98316a6c098ae7da"
format_stamp: "Formatted at 2026-08-12 11:10:24 on dist-test-slave-rmhg"
server_key: "9a1dc43d5ffd993510ca34f4fc8f38f8"
server_key_iv: "4a5d11529bf3e0d7158cc415dd6b3120"
server_key_version: "encryptionkey@0"
I20260812 11:10:24.805742 8652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:24.864305 8652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:24.869422 8652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:24.869787 8652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:24.871112 8652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:24.873068 8652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:24.873206 8652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 11:10:24.873351 8652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:24.873413 8652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:24.906383 8652 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:45803
I20260812 11:10:24.906430 8882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:45803 every 8 connection(s)
I20260812 11:10:24.907745 8652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:24.911350 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 8652
I20260812 11:10:24.911598 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:24.912174 4201 external_mini_cluster.cc:1428] Setting key b037ee1775d7b31f3ae01eded6a512d2
Aug 12 11:10:24 dist-test-slave-rmhg krb5kdc[8248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533024, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:24.932377 8886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:24.910622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:43743 (local address 127.4.26.126:37419)
0812 11:10:24.911159 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:24.911167 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:24.912459 (+ 1292us) server_negotiation.cc:407] Connection header received
0812 11:10:24.914959 (+ 2500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:24.914963 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:24.915034 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:24.915154 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:24.917438 (+ 2284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:24.918236 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:24.920533 (+ 2297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:24.920990 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:24.921098 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:24.925459 (+ 4361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:24.925467 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:24.925472 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:24.925520 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:24.928769 (+ 3249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:24.929757 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:24.929763 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:24.929766 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:24.929933 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:24.930437 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:24.930442 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:24.930445 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:24.930790 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:24.930939 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:24.931729 (+ 790us) server_negotiation.cc:299] Negotiation successful
0812 11:10:24.931984 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":257,"threads_started":1}
I20260812 11:10:24.933355 8888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:24.911318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37419 (local address 127.4.26.66:43743)
0812 11:10:24.912240 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:24.912307 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:24.914617 (+ 2310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:24.915451 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:24.915465 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:24.916284 (+ 819us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:24.917216 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:24.917246 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:24.918427 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:24.918432 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:24.920338 (+ 1906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:24.920357 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:24.921275 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:24.921285 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:24.921613 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:24.922438 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:24.922465 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:24.925122 (+ 2657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:24.928968 (+ 3846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:24.928978 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:24.928999 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:24.929597 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:24.930063 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:24.930067 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:24.930070 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:24.930310 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:24.930915 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:24.930923 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:24.931313 (+ 390us) client_negotiation.cc:769] Sending connection context
0812 11:10:24.931577 (+ 264us) client_negotiation.cc:240] Negotiation successful
0812 11:10:24.932055 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"spinlock_wait_cycles":27008,"thread_start_us":449,"threads_started":1}
I20260812 11:10:24.935057 8883 heartbeater.cc:347] Connected to a master server at 127.4.26.126:37419
I20260812 11:10:24.935370 8883 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:24.936175 8883 heartbeater.cc:511] Master 127.4.26.126:37419 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
I20260812 11:10:24.937865 8313 ts_manager.cc:194] Registered new tserver with Master: 2cbd80efd87a4a9e98316a6c098ae7da (127.4.26.66:45803)
I20260812 11:10:24.938750 8313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:43743
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:10:24.966341 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37419
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:33091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:25.316915 8894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:25.317334 8894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:25.317492 8894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:25.325536 8894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:25.325731 8894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:25.325901 8894 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:10:25.336462 8894 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:33091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37419
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:25.337982 8894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:25.339439 8894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:25.353611 8902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:25.353694 8906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:25.353693 8903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:25.354533 8894 server_base.cc:1034] running on GCE node
I20260812 11:10:25.355298 8894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:25.356405 8894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:25.357641 8894 hybrid_clock.cc:648] HybridClock initialized: now 1786533025357571 us; error 77 us; skew 500 ppm
I20260812 11:10:25.357990 8894 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:10:25.358611 8645 heartbeater.cc:503] Master 127.4.26.126:37419 was elected leader, sending a full tablet report...
Aug 12 11:10:25 dist-test-slave-rmhg krb5kdc[8248](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533025, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:25.361630 8894 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:10:25.363300 8894 webserver.cc:460] Webserver started at http://127.4.26.67:43049/ using document root <none> and password file <none>
I20260812 11:10:25.364066 8894 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:25.364202 8894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:25.364548 8894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:25.367878 8894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "22fe11c8ca574f72947a77db4d2b4a81"
format_stamp: "Formatted at 2026-08-12 11:10:25 on dist-test-slave-rmhg"
server_key: "e7069fe4d6663ad6b455cb197b3eda87"
server_key_iv: "26dbf411ecba0ac600555b8d0292bcf3"
server_key_version: "encryptionkey@0"
I20260812 11:10:25.368760 8894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "22fe11c8ca574f72947a77db4d2b4a81"
format_stamp: "Formatted at 2026-08-12 11:10:25 on dist-test-slave-rmhg"
server_key: "e7069fe4d6663ad6b455cb197b3eda87"
server_key_iv: "26dbf411ecba0ac600555b8d0292bcf3"
server_key_version: "encryptionkey@0"
I20260812 11:10:25.374656 8894 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.002s
I20260812 11:10:25.378818 8916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:25.380417 8894 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:10:25.380625 8894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "22fe11c8ca574f72947a77db4d2b4a81"
format_stamp: "Formatted at 2026-08-12 11:10:25 on dist-test-slave-rmhg"
server_key: "e7069fe4d6663ad6b455cb197b3eda87"
server_key_iv: "26dbf411ecba0ac600555b8d0292bcf3"
server_key_version: "encryptionkey@0"
I20260812 11:10:25.380834 8894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:25.398010 8894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:25.403612 8894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:25.403959 8894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:25.405505 8894 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:25.407173 8894 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:25.407266 8894 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:25.407390 8894 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:25.407450 8894 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:25.441790 8894 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:44631
I20260812 11:10:25.441844 9100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:44631 every 8 connection(s)
I20260812 11:10:25.443240 8894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:25.449626 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 8894
I20260812 11:10:25.449836 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:25.450292 4201 external_mini_cluster.cc:1428] Setting key cd2cb5cefc4c10fc9e7fe1335114f0ad
Aug 12 11:10:25 dist-test-slave-rmhg krb5kdc[8248](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533025, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:25.466320 9105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:25.446176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:52971 (local address 127.4.26.126:37419)
0812 11:10:25.446688 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:25.446693 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:25.447705 (+ 1012us) server_negotiation.cc:407] Connection header received
0812 11:10:25.449806 (+ 2101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:25.449812 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:25.449929 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:25.450058 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:25.452155 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:25.453088 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:25.454914 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:25.455339 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:25.455461 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:25.459574 (+ 4113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:25.459580 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:25.459584 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:25.459625 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:25.462599 (+ 2974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:25.463491 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:25.463496 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:25.463499 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:25.463646 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:25.464154 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:25.464159 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:25.464161 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:25.464487 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:25.464656 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:25.465615 (+ 959us) server_negotiation.cc:299] Negotiation successful
0812 11:10:25.465887 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":292,"threads_started":1}
I20260812 11:10:25.467463 9107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:25.446650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37419 (local address 127.4.26.67:52971)
0812 11:10:25.447505 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:25.447550 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:25.449448 (+ 1898us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:25.450397 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:25.450411 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:25.451178 (+ 767us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:25.451955 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:25.451983 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:25.453286 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:25.453290 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:25.454749 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:25.454765 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:25.455603 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:25.455611 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:25.455867 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:25.456666 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:25.456693 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:25.459284 (+ 2591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:25.462800 (+ 3516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:25.462810 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:25.462827 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:25.463342 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:25.463778 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:25.463784 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:25.463788 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:25.464025 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:25.464647 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:25.464657 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:25.465140 (+ 483us) client_negotiation.cc:769] Sending connection context
0812 11:10:25.465484 (+ 344us) client_negotiation.cc:240] Negotiation successful
0812 11:10:25.466132 (+ 648us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":329,"threads_started":1}
I20260812 11:10:25.469127 9103 heartbeater.cc:347] Connected to a master server at 127.4.26.126:37419
I20260812 11:10:25.469527 9103 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:25.470353 9103 heartbeater.cc:511] Master 127.4.26.126:37419 requested a full tablet report, sending...
I20260812 11:10:25.472170 8313 ts_manager.cc:194] Registered new tserver with Master: 22fe11c8ca574f72947a77db4d2b4a81 (127.4.26.67:44631)
I20260812 11:10:25.473026 8313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:52971
I20260812 11:10:25.480141 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 11:10:25.517292 9105 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:25.514510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49624 (local address 127.4.26.126:37419)
0812 11:10:25.514696 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:25.514701 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:25.515178 (+ 477us) server_negotiation.cc:407] Connection header received
0812 11:10:25.515377 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:25.515382 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:25.515458 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:25.515610 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:25.516978 (+ 1368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49624: BlockingRecv error: recv got EOF from 127.0.0.1:49624 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 11:10:25.520421 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 8411
W20260812 11:10:25.523437 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 8411: Not authorized: Client connection negotiation failed: client connection to 127.4.26.65:35041: server requires authentication, but client does not have Kerberos credentials available
I20260812 11:10:25.523669 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 8411
I20260812 11:10:25.561686 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 8652
W20260812 11:10:25.564775 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 8652: Not authorized: Client connection negotiation failed: client connection to 127.4.26.66:45803: server requires authentication, but client does not have Kerberos credentials available
I20260812 11:10:25.564946 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 8652
I20260812 11:10:25.591094 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 8894
W20260812 11:10:25.594395 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 8894: Not authorized: Client connection negotiation failed: client connection to 127.4.26.67:44631: server requires authentication, but client does not have Kerberos credentials available
I20260812 11:10:25.594568 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 8894
I20260812 11:10:25.618332 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 8266
I20260812 11:10:25.619771 8367 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:25.724195 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 8266
2026-08-12T11:10:25Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4744 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:25 dist-test-slave-rmhg krb5kdc[9131](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:25 dist-test-slave-rmhg krb5kdc[9131](info): set up 2 sockets
Aug 12 11:10:25 dist-test-slave-rmhg krb5kdc[9131](info): commencing operation
krb5kdc: starting...
W20260812 11:10:26.982726 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.001s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:10:27 dist-test-slave-rmhg krb5kdc[9131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:10:27.209662 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:43889
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:37687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:43889
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:27.556107 9159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:27.556442 9159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:27.556562 9159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:27.564114 9159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:27.564256 9159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:27.564309 9159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:27.564391 9159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:27.564464 9159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:27.574951 9159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:37687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:43889
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:43889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:27.576409 9159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:27.577853 9159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:27.590981 9175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:27.590891 9176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:27.590935 9179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:27.591928 9159 server_base.cc:1034] running on GCE node
I20260812 11:10:27.592774 9159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:27.594684 9159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:27.595930 9159 hybrid_clock.cc:648] HybridClock initialized: now 1786533027595883 us; error 40 us; skew 500 ppm
I20260812 11:10:27.596333 9159 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:27 dist-test-slave-rmhg krb5kdc[9131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533027, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:27.600123 9159 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:10:27.601963 9159 webserver.cc:460] Webserver started at http://127.4.26.126:46727/ using document root <none> and password file <none>
I20260812 11:10:27.602717 9159 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:27.602847 9159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:27.603165 9159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:27.606582 9159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "448852bd19514d51a3bcbae4310d7f1c"
format_stamp: "Formatted at 2026-08-12 11:10:27 on dist-test-slave-rmhg"
server_key: "aa95c0f4206d1b17ef6745af4ff330a5"
server_key_iv: "14de46b1d6f03733963b5cad1d857d37"
server_key_version: "encryptionkey@0"
I20260812 11:10:27.607430 9159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "448852bd19514d51a3bcbae4310d7f1c"
format_stamp: "Formatted at 2026-08-12 11:10:27 on dist-test-slave-rmhg"
server_key: "aa95c0f4206d1b17ef6745af4ff330a5"
server_key_iv: "14de46b1d6f03733963b5cad1d857d37"
server_key_version: "encryptionkey@0"
I20260812 11:10:27.613329 9159 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:10:27.617575 9188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:27.619336 9159 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:10:27.619573 9159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "448852bd19514d51a3bcbae4310d7f1c"
format_stamp: "Formatted at 2026-08-12 11:10:27 on dist-test-slave-rmhg"
server_key: "aa95c0f4206d1b17ef6745af4ff330a5"
server_key_iv: "14de46b1d6f03733963b5cad1d857d37"
server_key_version: "encryptionkey@0"
I20260812 11:10:27.619807 9159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:27.632398 9159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:27.637233 9159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:27.637733 9159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:27.657208 9159 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:43889
I20260812 11:10:27.657239 9269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:43889 every 8 connection(s)
I20260812 11:10:27.658767 9159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:27.663051 9270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:27.663404 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 9159
I20260812 11:10:27.663636 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:10:27.664513 4201 external_mini_cluster.cc:1428] Setting key 80bfeade0a47313dc54d6f8565d91a8f
I20260812 11:10:27.678659 9270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c: Bootstrap starting.
Aug 12 11:10:27 dist-test-slave-rmhg krb5kdc[9131](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:27.682753 9270 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:27.684216 9270 log.cc:824] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:27.688009 9270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c: No bootstrap required, opened a new log
I20260812 11:10:27.692804 9274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:27.666676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35872 (local address 127.4.26.126:43889)
0812 11:10:27.667596 (+ 920us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:27.667610 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:27.667654 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:10:27.670054 (+ 2400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:27.670088 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:27.670643 (+ 555us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:27.671066 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:27.673103 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:27.674669 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:27.676562 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:27.677394 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:27.677573 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:27.682408 (+ 4835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:27.682421 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:27.682443 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:27.682499 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:27.686415 (+ 3916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:27.687494 (+ 1079us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:27.687504 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:27.687514 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:27.687857 (+ 343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:27.688667 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:27.688672 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:27.688675 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:27.689827 (+ 1152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:27.690179 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:27.690714 (+ 535us) server_negotiation.cc:299] Negotiation successful
0812 11:10:27.691237 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":677,"thread_start_us":434,"threads_started":1}
I20260812 11:10:27.697425 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:27.698001 9270 raft_consensus.cc:348] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448852bd19514d51a3bcbae4310d7f1c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43889 } }
I20260812 11:10:27.698488 9270 raft_consensus.cc:374] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:27.698596 9270 raft_consensus.cc:729] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 448852bd19514d51a3bcbae4310d7f1c, State: Initialized, Role: FOLLOWER
I20260812 11:10:27.699294 9270 consensus_queue.cc:260] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448852bd19514d51a3bcbae4310d7f1c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43889 } }
I20260812 11:10:27.699581 9270 raft_consensus.cc:388] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:27.699728 9270 raft_consensus.cc:482] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:27.699919 9270 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:27.703186 9270 raft_consensus.cc:504] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448852bd19514d51a3bcbae4310d7f1c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43889 } }
I20260812 11:10:27.703908 9270 leader_election.cc:302] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 448852bd19514d51a3bcbae4310d7f1c; no voters:
I20260812 11:10:27.704681 9270 leader_election.cc:288] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:27.704829 9276 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:27.706142 9276 raft_consensus.cc:686] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [term 1 LEADER]: Becoming Leader. State: Replica: 448852bd19514d51a3bcbae4310d7f1c, State: Running, Role: LEADER
I20260812 11:10:27.706728 9276 consensus_queue.cc:237] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448852bd19514d51a3bcbae4310d7f1c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43889 } }
I20260812 11:10:27.707145 9270 sys_catalog.cc:564] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:27.709930 9279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 448852bd19514d51a3bcbae4310d7f1c. Latest consensus state: current_term: 1 leader_uuid: "448852bd19514d51a3bcbae4310d7f1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448852bd19514d51a3bcbae4310d7f1c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43889 } } }
I20260812 11:10:27.710358 9279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:27.710902 9278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "448852bd19514d51a3bcbae4310d7f1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "448852bd19514d51a3bcbae4310d7f1c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43889 } } }
I20260812 11:10:27.711328 9278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:27.722749 9287 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:27.728439 9287 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:27.746369 9306 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 11:10:27.749141 9287 catalog_manager.cc:1347] Generated new cluster ID: edd92d0cd30046c7b34f8f7c4c73c513
I20260812 11:10:27.749315 9287 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:27.771247 9287 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:27.773839 9287 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:27.778158 9274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:27.768376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35884 (local address 127.4.26.126:43889)
0812 11:10:27.768547 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:27.768552 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:27.769215 (+ 663us) server_negotiation.cc:407] Connection header received
0812 11:10:27.769508 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:27.769513 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:27.769605 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:27.769730 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:27.770951 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:27.771827 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:27.773411 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:27.774296 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:27.774459 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:27.775852 (+ 1393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:27.775858 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:27.775862 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:27.776744 (+ 882us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:27.776823 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:27.776858 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:27.777002 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:27.777272 (+ 270us) server_negotiation.cc:299] Negotiation successful
0812 11:10:27.777423 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":81,"server-negotiator.queue_time_us":47}
I20260812 11:10:27.786401 9287 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 448852bd19514d51a3bcbae4310d7f1c: Generated new TSK 0
I20260812 11:10:27.787544 9287 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:27.802572 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 9159
I20260812 11:10:27.803993 9262 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:27.896507 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 9159
2026-08-12T11:10:27Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2176 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:28 dist-test-slave-rmhg krb5kdc[9322](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:28 dist-test-slave-rmhg krb5kdc[9322](info): set up 2 sockets
Aug 12 11:10:28 dist-test-slave-rmhg krb5kdc[9322](info): commencing operation
krb5kdc: starting...
W20260812 11:10:29.142138 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.198s user 0.007s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:10:29 dist-test-slave-rmhg krb5kdc[9322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:10:29.369881 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:33181
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:41683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:33181
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:29.722203 9346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:29.722585 9346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:29.722733 9346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:29.730712 9346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:29.730878 9346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:29.730978 9346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:29.731076 9346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:29.731123 9346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:29.741855 9346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:41683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:33181
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:33181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:29.743300 9346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:29.744673 9346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:29.757732 9353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:29.757627 9354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:29.758308 9358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:29.758674 9346 server_base.cc:1034] running on GCE node
I20260812 11:10:29.759611 9346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:29.761389 9346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:29.762653 9346 hybrid_clock.cc:648] HybridClock initialized: now 1786533029762575 us; error 78 us; skew 500 ppm
I20260812 11:10:29.763062 9346 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:29 dist-test-slave-rmhg krb5kdc[9322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533029, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:29.766661 9346 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:10:29.768416 9346 webserver.cc:460] Webserver started at http://127.4.26.126:39637/ using document root <none> and password file <none>
I20260812 11:10:29.769217 9346 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:29.769371 9346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:29.769718 9346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:29.773041 9346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "16fa1f65bff34b26bb0ad223f84cb2da"
format_stamp: "Formatted at 2026-08-12 11:10:29 on dist-test-slave-rmhg"
server_key: "7a9ecb974420b5e26ec5b7044391d1f0"
server_key_iv: "26c8bce7cfc3a26c65893062ee0e855b"
server_key_version: "encryptionkey@0"
I20260812 11:10:29.773959 9346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "16fa1f65bff34b26bb0ad223f84cb2da"
format_stamp: "Formatted at 2026-08-12 11:10:29 on dist-test-slave-rmhg"
server_key: "7a9ecb974420b5e26ec5b7044391d1f0"
server_key_iv: "26c8bce7cfc3a26c65893062ee0e855b"
server_key_version: "encryptionkey@0"
I20260812 11:10:29.780157 9346 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 11:10:29.784430 9367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:29.786211 9346 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:10:29.786432 9346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "16fa1f65bff34b26bb0ad223f84cb2da"
format_stamp: "Formatted at 2026-08-12 11:10:29 on dist-test-slave-rmhg"
server_key: "7a9ecb974420b5e26ec5b7044391d1f0"
server_key_iv: "26c8bce7cfc3a26c65893062ee0e855b"
server_key_version: "encryptionkey@0"
I20260812 11:10:29.786660 9346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:29.801486 9346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:29.806782 9346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:29.807266 9346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:29.827162 9346 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:33181
I20260812 11:10:29.827203 9453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:33181 every 8 connection(s)
I20260812 11:10:29.828706 9346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:29.833024 9454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:29.833501 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 9346
I20260812 11:10:29.833742 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:10:29.834424 4201 external_mini_cluster.cc:1428] Setting key 50b4e1bd6e0a9fc844ef9d2e69bbfbda
I20260812 11:10:29.849526 9454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da: Bootstrap starting.
Aug 12 11:10:29 dist-test-slave-rmhg krb5kdc[9322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:29.854095 9454 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:29.855351 9454 log.cc:824] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:29.859508 9454 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da: No bootstrap required, opened a new log
I20260812 11:10:29.863533 9460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:29.836814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41538 (local address 127.4.26.126:33181)
0812 11:10:29.837929 (+ 1115us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:29.837946 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:29.837998 (+ 52us) server_negotiation.cc:407] Connection header received
0812 11:10:29.840093 (+ 2095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:29.840135 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:29.840707 (+ 572us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:29.841125 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:29.843157 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:29.844721 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:29.846972 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:29.847818 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:29.848053 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:29.853838 (+ 5785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:29.853849 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:29.853869 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:29.853928 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:29.857802 (+ 3874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:29.859020 (+ 1218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:29.859030 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:29.859040 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:29.859263 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:29.859834 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:29.859840 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:29.859842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:29.860530 (+ 688us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:29.860831 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:29.861494 (+ 663us) server_negotiation.cc:299] Negotiation successful
0812 11:10:29.862223 (+ 729us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":701,"thread_start_us":462,"threads_started":1}
I20260812 11:10:29.869634 9454 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16fa1f65bff34b26bb0ad223f84cb2da" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33181 } }
I20260812 11:10:29.870091 9454 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:29.870213 9454 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16fa1f65bff34b26bb0ad223f84cb2da, State: Initialized, Role: FOLLOWER
I20260812 11:10:29.870949 9454 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16fa1f65bff34b26bb0ad223f84cb2da" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33181 } }
I20260812 11:10:29.871217 9454 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:29.871377 9454 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:29.871567 9454 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:29.874015 9454 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16fa1f65bff34b26bb0ad223f84cb2da" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33181 } }
I20260812 11:10:29.874637 9454 leader_election.cc:302] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16fa1f65bff34b26bb0ad223f84cb2da; no voters:
I20260812 11:10:29.875320 9454 leader_election.cc:288] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:29.875497 9465 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:29.876307 9465 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [term 1 LEADER]: Becoming Leader. State: Replica: 16fa1f65bff34b26bb0ad223f84cb2da, State: Running, Role: LEADER
I20260812 11:10:29.876991 9465 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16fa1f65bff34b26bb0ad223f84cb2da" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33181 } }
I20260812 11:10:29.877938 9454 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:29.880203 9466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16fa1f65bff34b26bb0ad223f84cb2da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16fa1f65bff34b26bb0ad223f84cb2da" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33181 } } }
I20260812 11:10:29.880481 9467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16fa1f65bff34b26bb0ad223f84cb2da. Latest consensus state: current_term: 1 leader_uuid: "16fa1f65bff34b26bb0ad223f84cb2da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16fa1f65bff34b26bb0ad223f84cb2da" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33181 } } }
I20260812 11:10:29.880787 9466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:29.881008 9467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:29.882926 9474 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:29.888550 9474 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:29.899232 9474 catalog_manager.cc:1347] Generated new cluster ID: 48c001fd75cc4ecbb04c155de8ad08c2
I20260812 11:10:29.899376 9474 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:29.914635 9474 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:29.916710 9474 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:29.931550 9474 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16fa1f65bff34b26bb0ad223f84cb2da: Generated new TSK 0
I20260812 11:10:29.932475 9474 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:10:29.992404 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33181
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:41683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:30.352684 9502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:30.353032 9502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:30.353199 9502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:30.361436 9502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:30.361583 9502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:30.361737 9502 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:10:30.372572 9502 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:41683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33181
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:30.374205 9502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:30.375936 9502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:30.394970 9507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:30.395007 9510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:30.395030 9513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:30.395844 9502 server_base.cc:1034] running on GCE node
I20260812 11:10:30.396620 9502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:30.397861 9502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:30.399120 9502 hybrid_clock.cc:648] HybridClock initialized: now 1786533030399050 us; error 69 us; skew 500 ppm
I20260812 11:10:30.399537 9502 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:30 dist-test-slave-rmhg krb5kdc[9322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533030, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:30.403301 9502 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:10:30.405092 9502 webserver.cc:460] Webserver started at http://127.4.26.65:42155/ using document root <none> and password file <none>
I20260812 11:10:30.405889 9502 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:30.406008 9502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:30.406312 9502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:30.409579 9502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "071ef65373f04efbbf473da2d8889b2a"
format_stamp: "Formatted at 2026-08-12 11:10:30 on dist-test-slave-rmhg"
server_key: "85b6c315d964dcf083d50e2a58865bc1"
server_key_iv: "3c7c12f2fd8ec844aed926a0111a53e1"
server_key_version: "encryptionkey@0"
I20260812 11:10:30.410449 9502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "071ef65373f04efbbf473da2d8889b2a"
format_stamp: "Formatted at 2026-08-12 11:10:30 on dist-test-slave-rmhg"
server_key: "85b6c315d964dcf083d50e2a58865bc1"
server_key_iv: "3c7c12f2fd8ec844aed926a0111a53e1"
server_key_version: "encryptionkey@0"
I20260812 11:10:30.416376 9502 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260812 11:10:30.420604 9523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:30.422389 9502 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:10:30.422583 9502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "071ef65373f04efbbf473da2d8889b2a"
format_stamp: "Formatted at 2026-08-12 11:10:30 on dist-test-slave-rmhg"
server_key: "85b6c315d964dcf083d50e2a58865bc1"
server_key_iv: "3c7c12f2fd8ec844aed926a0111a53e1"
server_key_version: "encryptionkey@0"
I20260812 11:10:30.422792 9502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:30.441531 9502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:30.446959 9502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:30.447297 9502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:30.448393 9502 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:30.450073 9502 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:30.450156 9502 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:30.450282 9502 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:30.450336 9502 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:30.482752 9502 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:38773
I20260812 11:10:30.482839 9720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:38773 every 8 connection(s)
I20260812 11:10:30.484179 9502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:30.486637 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 9502
I20260812 11:10:30.486856 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:30.487710 4201 external_mini_cluster.cc:1428] Setting key af9ce93ff34ef6daa9ff240072ac71eb
Aug 12 11:10:30 dist-test-slave-rmhg krb5kdc[9322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533030, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:30.507508 9724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:30.487020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:59311 (local address 127.4.26.126:33181)
0812 11:10:30.487467 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:30.487472 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:30.488833 (+ 1361us) server_negotiation.cc:407] Connection header received
0812 11:10:30.491154 (+ 2321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:30.491160 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:30.491249 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:30.491346 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:30.493091 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:30.493875 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:30.495655 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:30.496074 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:30.496201 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:30.500508 (+ 4307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:30.500515 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:30.500518 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:30.500561 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:30.503395 (+ 2834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:30.504593 (+ 1198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:30.504598 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:30.504601 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:30.504838 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:30.505502 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:30.505509 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:30.505512 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:30.505839 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:30.505992 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:30.507034 (+ 1042us) server_negotiation.cc:299] Negotiation successful
0812 11:10:30.507242 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":243,"threads_started":1}
I20260812 11:10:30.509181 9726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:30.487746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:33181 (local address 127.4.26.65:59311)
0812 11:10:30.488649 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:30.488713 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:30.490850 (+ 2137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:30.491662 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:30.491674 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:30.492252 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:30.492891 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:30.492911 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:30.494071 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:30.494076 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:30.495457 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:30.495473 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:30.496350 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:30.496360 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:30.496602 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:30.497400 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:30.497432 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:30.500160 (+ 2728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:30.503629 (+ 3469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:30.503655 (+ 26us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:30.503679 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:30.504402 (+ 723us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:30.505006 (+ 604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:30.505012 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:30.505016 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:30.505362 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:30.505996 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:30.506007 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:30.506567 (+ 560us) client_negotiation.cc:769] Sending connection context
0812 11:10:30.506935 (+ 368us) client_negotiation.cc:240] Negotiation successful
0812 11:10:30.507588 (+ 653us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":347,"threads_started":1}
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
I20260812 11:10:30.510931 9722 heartbeater.cc:347] Connected to a master server at 127.4.26.126:33181
I20260812 11:10:30.511348 9722 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
I20260812 11:10:30.512316 9722 heartbeater.cc:511] Master 127.4.26.126:33181 requested a full tablet report, sending...
I20260812 11:10:30.515264 9392 ts_manager.cc:194] Registered new tserver with Master: 071ef65373f04efbbf473da2d8889b2a (127.4.26.65:38773)
I20260812 11:10:30.517351 9392 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:59311
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:10:30.540850 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33181
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:41683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:30.897414 9732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:30.897796 9732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:30.897918 9732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:30.905465 9732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:30.905596 9732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:30.905741 9732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:10:30.915843 9732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:41683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33181
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:30.917259 9732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:30.918632 9732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:30.932741 9743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:30.932842 9745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:30.932817 9741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:30.939051 9732 server_base.cc:1034] running on GCE node
I20260812 11:10:30.939811 9732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:30.940865 9732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:30.942085 9732 hybrid_clock.cc:648] HybridClock initialized: now 1786533030942014 us; error 58 us; skew 500 ppm
I20260812 11:10:30.942430 9732 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:30 dist-test-slave-rmhg krb5kdc[9322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533030, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:30.948823 9732 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:10:30.950731 9732 webserver.cc:460] Webserver started at http://127.4.26.66:44317/ using document root <none> and password file <none>
I20260812 11:10:30.951527 9732 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:30.951648 9732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:30.951944 9732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:30.955251 9732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "ecba4918b3b94b10bd8a937ac9215b41"
format_stamp: "Formatted at 2026-08-12 11:10:30 on dist-test-slave-rmhg"
server_key: "9d94c992ac457e1b2e9954b24bc2676c"
server_key_iv: "964f6c2d2a3b23555120380d60d9c2ee"
server_key_version: "encryptionkey@0"
I20260812 11:10:30.956084 9732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "ecba4918b3b94b10bd8a937ac9215b41"
format_stamp: "Formatted at 2026-08-12 11:10:30 on dist-test-slave-rmhg"
server_key: "9d94c992ac457e1b2e9954b24bc2676c"
server_key_iv: "964f6c2d2a3b23555120380d60d9c2ee"
server_key_version: "encryptionkey@0"
I20260812 11:10:30.961771 9732 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:10:30.965663 9754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:30.967208 9732 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:10:30.967367 9732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "ecba4918b3b94b10bd8a937ac9215b41"
format_stamp: "Formatted at 2026-08-12 11:10:30 on dist-test-slave-rmhg"
server_key: "9d94c992ac457e1b2e9954b24bc2676c"
server_key_iv: "964f6c2d2a3b23555120380d60d9c2ee"
server_key_version: "encryptionkey@0"
I20260812 11:10:30.967553 9732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:30.994692 9732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:30.999614 9732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:30.999907 9732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:31.000994 9732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:31.002563 9732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:31.002640 9732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:31.002733 9732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:31.002777 9732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:31.034919 9732 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:36491
I20260812 11:10:31.034996 9941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:36491 every 8 connection(s)
I20260812 11:10:31.036265 9732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:31.044881 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 9732
I20260812 11:10:31.045083 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:31.045698 4201 external_mini_cluster.cc:1428] Setting key b7bee3b8866f543104b37e9861e84d46
Aug 12 11:10:31 dist-test-slave-rmhg krb5kdc[9322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533030, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:31.058625 9946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:31.039137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:46857 (local address 127.4.26.126:33181)
0812 11:10:31.039643 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:31.039649 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:31.040676 (+ 1027us) server_negotiation.cc:407] Connection header received
0812 11:10:31.042727 (+ 2051us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:31.042733 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:31.042809 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:31.042895 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:31.044643 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:31.045854 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:31.047864 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:31.048300 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:31.048419 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:31.052299 (+ 3880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:31.052305 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:31.052309 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:31.052349 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:31.055145 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:31.056006 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:31.056011 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:31.056014 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:31.056158 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:31.056633 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:31.056638 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:31.056640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:31.056941 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:31.057089 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:31.057934 (+ 845us) server_negotiation.cc:299] Negotiation successful
0812 11:10:31.058239 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":242,"threads_started":1}
I20260812 11:10:31.059813 9947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:31.039676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:33181 (local address 127.4.26.66:46857)
0812 11:10:31.040485 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:31.040530 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:31.042370 (+ 1840us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:31.043154 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:31.043164 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:31.043725 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:31.044370 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:31.044412 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:31.046076 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:31.046081 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:31.047704 (+ 1623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:31.047719 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:31.048545 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:31.048554 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:31.048795 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:31.049516 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:31.049542 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:31.051999 (+ 2457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:31.055325 (+ 3326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:31.055337 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:31.055358 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:31.055861 (+ 503us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:31.056283 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:31.056288 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:31.056292 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:31.056508 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:31.057099 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:31.057110 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:31.057539 (+ 429us) client_negotiation.cc:769] Sending connection context
0812 11:10:31.057818 (+ 279us) client_negotiation.cc:240] Negotiation successful
0812 11:10:31.058450 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":314,"threads_started":1}
I20260812 11:10:31.061661 9943 heartbeater.cc:347] Connected to a master server at 127.4.26.126:33181
I20260812 11:10:31.062000 9943 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:31.062822 9943 heartbeater.cc:511] Master 127.4.26.126:33181 requested a full tablet report, sending...
I20260812 11:10:31.064579 9392 ts_manager.cc:194] Registered new tserver with Master: ecba4918b3b94b10bd8a937ac9215b41 (127.4.26.66:36491)
I20260812 11:10:31.065835 9392 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:46857
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:10:31.096539 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33181
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:41683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:31.448865 9952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:31.449213 9952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:31.449334 9952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:31.456740 9952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:31.456876 9952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:31.456993 9952 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:10:31.467130 9952 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:41683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33181
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:31.468442 9952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:31.469784 9952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:31.483371 9958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:31.483666 9961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:31.484014 9957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:31.487114 9952 server_base.cc:1034] running on GCE node
I20260812 11:10:31.487840 9952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:31.488911 9952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:31.490183 9952 hybrid_clock.cc:648] HybridClock initialized: now 1786533031490105 us; error 69 us; skew 500 ppm
I20260812 11:10:31.490571 9952 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:31 dist-test-slave-rmhg krb5kdc[9322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533031, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:31.494199 9952 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:10:31.495944 9952 webserver.cc:460] Webserver started at http://127.4.26.67:46011/ using document root <none> and password file <none>
I20260812 11:10:31.496733 9952 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:31.496851 9952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:31.497205 9952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:31.500578 9952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "bf53a19e7c0248d893f70f1f775f5f99"
format_stamp: "Formatted at 2026-08-12 11:10:31 on dist-test-slave-rmhg"
server_key: "509933d43dce38e837e3bba43153b5de"
server_key_iv: "e080fa7d87798d0db8525c550dc1b9e4"
server_key_version: "encryptionkey@0"
I20260812 11:10:31.501593 9952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "bf53a19e7c0248d893f70f1f775f5f99"
format_stamp: "Formatted at 2026-08-12 11:10:31 on dist-test-slave-rmhg"
server_key: "509933d43dce38e837e3bba43153b5de"
server_key_iv: "e080fa7d87798d0db8525c550dc1b9e4"
server_key_version: "encryptionkey@0"
I20260812 11:10:31.507619 9952 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s
I20260812 11:10:31.511669 9974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:31.513494 9952 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:31.513693 9952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "bf53a19e7c0248d893f70f1f775f5f99"
format_stamp: "Formatted at 2026-08-12 11:10:31 on dist-test-slave-rmhg"
server_key: "509933d43dce38e837e3bba43153b5de"
server_key_iv: "e080fa7d87798d0db8525c550dc1b9e4"
server_key_version: "encryptionkey@0"
I20260812 11:10:31.513923 9952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:31.521270 9722 heartbeater.cc:503] Master 127.4.26.126:33181 was elected leader, sending a full tablet report...
I20260812 11:10:31.535221 9952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:31.540472 9952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:31.540809 9952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:31.541975 9952 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:31.543700 9952 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:31.543787 9952 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:31.543915 9952 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:31.543967 9952 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:31.577347 9952 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:38659
I20260812 11:10:31.577410 10168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:38659 every 8 connection(s)
I20260812 11:10:31.578755 9952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:31.580346 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 9952
I20260812 11:10:31.580528 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:31.581103 4201 external_mini_cluster.cc:1428] Setting key 7ab319fe17e412c21dc9918e1b799ff4
Aug 12 11:10:31 dist-test-slave-rmhg krb5kdc[9322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533031, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:31.602246 10171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:31.582494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:33275 (local address 127.4.26.126:33181)
0812 11:10:31.583137 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:31.583141 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:31.585228 (+ 2087us) server_negotiation.cc:407] Connection header received
0812 11:10:31.586465 (+ 1237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:31.586471 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:31.586574 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:31.586673 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:31.588438 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:31.589316 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:31.591427 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:31.591971 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:31.592103 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:31.596209 (+ 4106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:31.596215 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:31.596219 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:31.596259 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:31.598930 (+ 2671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:31.599743 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:31.599749 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:31.599752 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:31.599880 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:31.600344 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:31.600348 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:31.600350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:31.600635 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:31.600789 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:31.601601 (+ 812us) server_negotiation.cc:299] Negotiation successful
0812 11:10:31.601842 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":386,"threads_started":1}
I20260812 11:10:31.603291 10173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:31.583384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:33181 (local address 127.4.26.67:33275)
0812 11:10:31.584280 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:31.584330 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:31.586169 (+ 1839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:31.586960 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:31.586970 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:31.587586 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:31.588228 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:31.588248 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:31.589506 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:31.589511 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:31.591237 (+ 1726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:31.591256 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:31.592253 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:31.592262 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:31.592518 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:31.593319 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:31.593352 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:31.595937 (+ 2585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:31.599095 (+ 3158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:31.599107 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:31.599127 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:31.599615 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:31.599996 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:31.600002 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:31.600006 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:31.600225 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:31.600777 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:31.600786 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:31.601221 (+ 435us) client_negotiation.cc:769] Sending connection context
0812 11:10:31.601505 (+ 284us) client_negotiation.cc:240] Negotiation successful
0812 11:10:31.602124 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":371,"threads_started":1}
I20260812 11:10:31.604873 10169 heartbeater.cc:347] Connected to a master server at 127.4.26.126:33181
I20260812 11:10:31.605253 10169 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:31.606081 10169 heartbeater.cc:511] Master 127.4.26.126:33181 requested a full tablet report, sending...
I20260812 11:10:31.607753 9392 ts_manager.cc:194] Registered new tserver with Master: bf53a19e7c0248d893f70f1f775f5f99 (127.4.26.67:38659)
I20260812 11:10:31.608913 9392 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:33275
I20260812 11:10:31.610212 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:10:31 dist-test-slave-rmhg krb5kdc[9322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533031, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 12 11:10:31 dist-test-slave-rmhg krb5kdc[9322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533031, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:31.666229 10171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:31.650439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41554 (local address 127.4.26.126:33181)
0812 11:10:31.650650 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:31.650655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:31.651131 (+ 476us) server_negotiation.cc:407] Connection header received
0812 11:10:31.651247 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:31.651252 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:31.651342 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:31.651442 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:31.653074 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:31.653923 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:31.655336 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:31.655801 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:31.655919 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:31.660450 (+ 4531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:31.660460 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:31.660465 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:31.660523 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:31.663334 (+ 2811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:31.664207 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:31.664212 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:31.664215 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:31.664361 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:31.664829 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:31.664832 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:31.664834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:31.665224 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:31.665416 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:31.665779 (+ 363us) server_negotiation.cc:299] Negotiation successful
0812 11:10:31.665972 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260812 11:10:31.666934 9392 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41554
I20260812 11:10:31.668454 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 9502
Aug 12 11:10:31 dist-test-slave-rmhg krb5kdc[9322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533031, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:10:31.687042 10187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:31.669788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51180 (local address 127.4.26.65:38773)
0812 11:10:31.670493 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:31.670501 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:31.670528 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:10:31.670590 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:31.670597 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:31.670818 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:31.670981 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:31.672249 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:31.673549 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:31.674865 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:31.675544 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:31.675674 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:31.680252 (+ 4578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:31.680270 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:31.680288 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:31.680332 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:31.683661 (+ 3329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:31.684517 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:31.684526 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:31.684528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:31.684719 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:31.685269 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:31.685274 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:31.685276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:31.685712 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:31.685986 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:31.686335 (+ 349us) server_negotiation.cc:299] Negotiation successful
0812 11:10:31.686642 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":323,"threads_started":1}
W20260812 11:10:31.688691 9714 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:51180
W20260812 11:10:31.690250 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 9502: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:10:31.690490 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 9502
I20260812 11:10:31.715098 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 9732
Aug 12 11:10:31 dist-test-slave-rmhg krb5kdc[9322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533031, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:10:31.733290 10190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:31.716149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46380 (local address 127.4.26.66:36491)
0812 11:10:31.716742 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:31.716750 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:31.716777 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:10:31.716842 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:31.716848 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:31.717069 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:31.717313 (+ 244us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:31.718740 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:31.719817 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:31.721131 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:31.721838 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:31.721977 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:31.726691 (+ 4714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:31.726710 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:31.726730 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:31.726775 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:31.730110 (+ 3335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:31.730921 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:31.730931 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:31.730934 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:31.731078 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:31.731493 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:31.731498 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:31.731500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:31.731895 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:31.732209 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:31.732591 (+ 382us) server_negotiation.cc:299] Negotiation successful
0812 11:10:31.732896 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":288,"threads_started":1}
W20260812 11:10:31.734745 9933 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:46380
W20260812 11:10:31.736032 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 9732: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:10:31.736196 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 9732
I20260812 11:10:31.760462 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 9952
Aug 12 11:10:31 dist-test-slave-rmhg krb5kdc[9322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533031, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:10:31.780153 10191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:31.761752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41320 (local address 127.4.26.67:38659)
0812 11:10:31.762438 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:31.762446 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:31.762478 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:10:31.762555 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:31.762561 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:31.762786 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:31.762929 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:31.764361 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:31.765666 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:31.767063 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:31.767713 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:31.767833 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:31.772912 (+ 5079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:31.772932 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:31.772954 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:31.773006 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:31.776162 (+ 3156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:31.777223 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:31.777233 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:31.777236 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:31.777415 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:31.778036 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:31.778041 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:31.778044 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:31.778601 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:31.778930 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:31.779435 (+ 505us) server_negotiation.cc:299] Negotiation successful
0812 11:10:31.779760 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":367,"threads_started":1}
W20260812 11:10:31.781560 10162 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41320
W20260812 11:10:31.782814 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 9952: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:10:31.783080 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 9952
I20260812 11:10:31.813776 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 9346
I20260812 11:10:31.815304 9447 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:31.921047 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 9346
2026-08-12T11:10:31Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4022 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:32 dist-test-slave-rmhg krb5kdc[10195](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:32 dist-test-slave-rmhg krb5kdc[10195](info): set up 2 sockets
Aug 12 11:10:32 dist-test-slave-rmhg krb5kdc[10195](info): commencing operation
krb5kdc: starting...
W20260812 11:10:33.172396 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:10:33 dist-test-slave-rmhg krb5kdc[10195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:10:33.407059 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:46693
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:36203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:46693
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:33.759853 10217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:33.760221 10217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:33.760360 10217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:33.767997 10217 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:33.768150 10217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:33.768235 10217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:33.768325 10217 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:33.768386 10217 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:33.778813 10217 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:36203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:46693
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:46693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:33.780370 10217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:33.781905 10217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:33.795297 10228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:33.795248 10235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:33.795297 10230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:33.796372 10217 server_base.cc:1034] running on GCE node
I20260812 11:10:33.797505 10217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:33.799381 10217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:33.800685 10217 hybrid_clock.cc:648] HybridClock initialized: now 1786533033800603 us; error 73 us; skew 500 ppm
I20260812 11:10:33.801198 10217 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:33 dist-test-slave-rmhg krb5kdc[10195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533033, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:33.805248 10217 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:10:33.807262 10217 webserver.cc:460] Webserver started at http://127.4.26.126:45385/ using document root <none> and password file <none>
I20260812 11:10:33.808123 10217 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:33.808262 10217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:33.808609 10217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:33.812561 10217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "deaeef4fca4f430993d94b095bdb193f"
format_stamp: "Formatted at 2026-08-12 11:10:33 on dist-test-slave-rmhg"
server_key: "130fe9c6d43a0187430c9de32cbd07e3"
server_key_iv: "cedcc4e7fc208cce457578610e42cab3"
server_key_version: "encryptionkey@0"
I20260812 11:10:33.813721 10217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "deaeef4fca4f430993d94b095bdb193f"
format_stamp: "Formatted at 2026-08-12 11:10:33 on dist-test-slave-rmhg"
server_key: "130fe9c6d43a0187430c9de32cbd07e3"
server_key_iv: "cedcc4e7fc208cce457578610e42cab3"
server_key_version: "encryptionkey@0"
I20260812 11:10:33.820919 10217 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260812 11:10:33.826182 10243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:33.828331 10217 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:10:33.828619 10217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "deaeef4fca4f430993d94b095bdb193f"
format_stamp: "Formatted at 2026-08-12 11:10:33 on dist-test-slave-rmhg"
server_key: "130fe9c6d43a0187430c9de32cbd07e3"
server_key_iv: "cedcc4e7fc208cce457578610e42cab3"
server_key_version: "encryptionkey@0"
I20260812 11:10:33.828872 10217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:33.846179 10217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:33.851533 10217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:33.851818 10217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:33.871241 10217 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:46693
I20260812 11:10:33.871268 10316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:46693 every 8 connection(s)
I20260812 11:10:33.872817 10217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:33.877027 10317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:33.880870 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 10217
I20260812 11:10:33.881140 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:10:33.881991 4201 external_mini_cluster.cc:1428] Setting key 3925c3ecfe102bad6926b7c906972dc9
I20260812 11:10:33.891472 10317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f: Bootstrap starting.
I20260812 11:10:33.895632 10317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:33.897135 10317 log.cc:824] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:10:33 dist-test-slave-rmhg krb5kdc[10195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:33.901031 10317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f: No bootstrap required, opened a new log
I20260812 11:10:33.909276 10322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:33.884372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32898 (local address 127.4.26.126:46693)
0812 11:10:33.885287 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:33.885300 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:33.885347 (+ 47us) server_negotiation.cc:407] Connection header received
0812 11:10:33.887062 (+ 1715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:33.887091 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:33.887590 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:33.887982 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:33.890033 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:33.891458 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:33.893367 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:33.894187 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:33.894348 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:33.899467 (+ 5119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:33.899490 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:33.899514 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:33.899567 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:33.903787 (+ 4220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:33.904724 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:33.904735 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:33.904750 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:33.905002 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:33.905540 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:33.905546 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:33.905550 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:33.906381 (+ 831us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:33.906712 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:33.907186 (+ 474us) server_negotiation.cc:299] Negotiation successful
0812 11:10:33.907727 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":390,"threads_started":1}
I20260812 11:10:33.911605 10317 raft_consensus.cc:348] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deaeef4fca4f430993d94b095bdb193f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 46693 } }
I20260812 11:10:33.912109 10317 raft_consensus.cc:374] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:33.912226 10317 raft_consensus.cc:729] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deaeef4fca4f430993d94b095bdb193f, State: Initialized, Role: FOLLOWER
I20260812 11:10:33.912914 10317 consensus_queue.cc:260] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deaeef4fca4f430993d94b095bdb193f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 46693 } }
I20260812 11:10:33.913254 10317 raft_consensus.cc:388] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:33.913375 10317 raft_consensus.cc:482] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:33.913506 10317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:33.915851 10317 raft_consensus.cc:504] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deaeef4fca4f430993d94b095bdb193f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 46693 } }
I20260812 11:10:33.916419 10317 leader_election.cc:302] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: deaeef4fca4f430993d94b095bdb193f; no voters:
I20260812 11:10:33.917230 10317 leader_election.cc:288] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:33.917378 10328 raft_consensus.cc:2781] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:33.918351 10328 raft_consensus.cc:686] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [term 1 LEADER]: Becoming Leader. State: Replica: deaeef4fca4f430993d94b095bdb193f, State: Running, Role: LEADER
I20260812 11:10:33.918907 10328 consensus_queue.cc:237] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deaeef4fca4f430993d94b095bdb193f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 46693 } }
I20260812 11:10:33.919694 10317 sys_catalog.cc:564] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:33.922461 10329 sys_catalog.cc:455] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "deaeef4fca4f430993d94b095bdb193f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deaeef4fca4f430993d94b095bdb193f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 46693 } } }
I20260812 11:10:33.922974 10329 sys_catalog.cc:458] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:33.923260 10330 sys_catalog.cc:455] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [sys.catalog]: SysCatalogTable state changed. Reason: New leader deaeef4fca4f430993d94b095bdb193f. Latest consensus state: current_term: 1 leader_uuid: "deaeef4fca4f430993d94b095bdb193f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "deaeef4fca4f430993d94b095bdb193f" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 46693 } } }
I20260812 11:10:33.923698 10330 sys_catalog.cc:458] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:33.923920 10342 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:33.934310 10342 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:33.944756 10342 catalog_manager.cc:1347] Generated new cluster ID: 1e40e977b97544c988809d28049cb3d3
I20260812 11:10:33.944958 10342 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:33.956511 10342 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:33.958084 10342 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:33.973452 10342 catalog_manager.cc:5868] T 00000000000000000000000000000000 P deaeef4fca4f430993d94b095bdb193f: Generated new TSK 0
I20260812 11:10:33.974714 10342 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:10:34.033216 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:46693
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:36203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:34.392266 10358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:34.392597 10358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:34.392724 10358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:34.400306 10358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:34.400447 10358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:34.400606 10358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:10:34.412072 10358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:36203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:46693
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:34.413576 10358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:34.414947 10358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:34.429730 10364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:34.429809 10370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:34.429783 10365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:34.430683 10358 server_base.cc:1034] running on GCE node
I20260812 11:10:34.431370 10358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:34.432420 10358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:34.433650 10358 hybrid_clock.cc:648] HybridClock initialized: now 1786533034433567 us; error 72 us; skew 500 ppm
I20260812 11:10:34.434062 10358 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:34 dist-test-slave-rmhg krb5kdc[10195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533034, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:34.437693 10358 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:10:34.439322 10358 webserver.cc:460] Webserver started at http://127.4.26.65:44409/ using document root <none> and password file <none>
I20260812 11:10:34.440069 10358 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:34.440200 10358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:34.440514 10358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:34.443959 10358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "5f9c6ff0caae4ab7a2404b2e79a6ffc5"
format_stamp: "Formatted at 2026-08-12 11:10:34 on dist-test-slave-rmhg"
server_key: "c368016ff31cdad03bce5fa93fc1ba6a"
server_key_iv: "bfe6941df2e019c340a953b190348cfb"
server_key_version: "encryptionkey@0"
I20260812 11:10:34.444839 10358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "5f9c6ff0caae4ab7a2404b2e79a6ffc5"
format_stamp: "Formatted at 2026-08-12 11:10:34 on dist-test-slave-rmhg"
server_key: "c368016ff31cdad03bce5fa93fc1ba6a"
server_key_iv: "bfe6941df2e019c340a953b190348cfb"
server_key_version: "encryptionkey@0"
I20260812 11:10:34.450543 10358 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260812 11:10:34.454519 10388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:34.456179 10358 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:10:34.456372 10358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "5f9c6ff0caae4ab7a2404b2e79a6ffc5"
format_stamp: "Formatted at 2026-08-12 11:10:34 on dist-test-slave-rmhg"
server_key: "c368016ff31cdad03bce5fa93fc1ba6a"
server_key_iv: "bfe6941df2e019c340a953b190348cfb"
server_key_version: "encryptionkey@0"
I20260812 11:10:34.456606 10358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:34.476647 10358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:34.481532 10358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:34.481830 10358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:34.482888 10358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:34.484386 10358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:34.484488 10358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:34.484617 10358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:34.484670 10358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:34.514433 10358 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:45411
I20260812 11:10:34.514479 10588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:45411 every 8 connection(s)
I20260812 11:10:34.515793 10358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:34.518560 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 10358
I20260812 11:10:34.518805 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:34.519721 4201 external_mini_cluster.cc:1428] Setting key e9422b45d936f0fa11e4758315eb9040
Aug 12 11:10:34 dist-test-slave-rmhg krb5kdc[10195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533034, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:34.538712 10592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:34.518730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:47271 (local address 127.4.26.126:46693)
0812 11:10:34.521011 (+ 2281us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:34.521028 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:34.521051 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:10:34.522648 (+ 1597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:34.522654 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:34.522750 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:34.522850 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:34.524627 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:34.525489 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:34.527182 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:34.527617 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:34.527741 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:34.531969 (+ 4228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:34.531976 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:34.531980 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:34.532019 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:34.534866 (+ 2847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:34.535926 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:34.535932 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:34.535935 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:34.536094 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:34.536675 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:34.536679 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:34.536681 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:34.536982 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:34.537109 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:34.538210 (+ 1101us) server_negotiation.cc:299] Negotiation successful
0812 11:10:34.538418 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2154,"thread_start_us":2034,"threads_started":1}
I20260812 11:10:34.540298 10593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:34.519254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:46693 (local address 127.4.26.65:47271)
0812 11:10:34.520255 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:34.520306 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:34.522348 (+ 2042us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:34.523149 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:34.523159 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:34.523739 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:34.524420 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:34.524457 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:34.525669 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:34.525674 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:34.527010 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:34.527025 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:34.527881 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:34.527890 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:34.528150 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:34.528856 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:34.528889 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:34.531636 (+ 2747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:34.535047 (+ 3411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:34.535069 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:34.535091 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:34.535754 (+ 663us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:34.536235 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:34.536241 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:34.536244 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:34.536538 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:34.537127 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:34.537138 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:34.537703 (+ 565us) client_negotiation.cc:769] Sending connection context
0812 11:10:34.538088 (+ 385us) client_negotiation.cc:240] Negotiation successful
0812 11:10:34.538741 (+ 653us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":679,"thread_start_us":397,"threads_started":1}
I20260812 11:10:34.542140 10589 heartbeater.cc:347] Connected to a master server at 127.4.26.126:46693
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
I20260812 11:10:34.542464 10589 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:34.543260 10589 heartbeater.cc:511] Master 127.4.26.126:46693 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
I20260812 11:10:34.545743 10267 ts_manager.cc:194] Registered new tserver with Master: 5f9c6ff0caae4ab7a2404b2e79a6ffc5 (127.4.26.65:45411)
I20260812 11:10:34.547273 10267 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:47271
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:10:34.574118 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:46693
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:36203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:34.948529 10601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:34.948850 10601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:34.948957 10601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:34.957021 10601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:34.957237 10601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:34.957420 10601 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:10:34.968544 10601 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:36203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:46693
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:34.970081 10601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:34.971508 10601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:34.987157 10609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:34.987229 10610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:34.987193 10614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:34.988158 10601 server_base.cc:1034] running on GCE node
I20260812 11:10:34.988962 10601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:34.990145 10601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:34.991421 10601 hybrid_clock.cc:648] HybridClock initialized: now 1786533034991346 us; error 70 us; skew 500 ppm
I20260812 11:10:34.991793 10601 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:34 dist-test-slave-rmhg krb5kdc[10195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533034, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:34.995267 10601 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:10:34.996912 10601 webserver.cc:460] Webserver started at http://127.4.26.66:41491/ using document root <none> and password file <none>
I20260812 11:10:34.997735 10601 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:34.997871 10601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:34.998206 10601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:35.001441 10601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "2bf2969671324113a810122986623ce7"
format_stamp: "Formatted at 2026-08-12 11:10:34 on dist-test-slave-rmhg"
server_key: "403e023523270e77a9f4855f672bd7ab"
server_key_iv: "ee5a5bcb40efbe6a1211ba8379814e2f"
server_key_version: "encryptionkey@0"
I20260812 11:10:35.002314 10601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "2bf2969671324113a810122986623ce7"
format_stamp: "Formatted at 2026-08-12 11:10:34 on dist-test-slave-rmhg"
server_key: "403e023523270e77a9f4855f672bd7ab"
server_key_iv: "ee5a5bcb40efbe6a1211ba8379814e2f"
server_key_version: "encryptionkey@0"
I20260812 11:10:35.008307 10601 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 11:10:35.012612 10628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:35.014344 10601 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:10:35.014561 10601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "2bf2969671324113a810122986623ce7"
format_stamp: "Formatted at 2026-08-12 11:10:34 on dist-test-slave-rmhg"
server_key: "403e023523270e77a9f4855f672bd7ab"
server_key_iv: "ee5a5bcb40efbe6a1211ba8379814e2f"
server_key_version: "encryptionkey@0"
I20260812 11:10:35.014808 10601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:35.033242 10601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:35.038030 10601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:35.038335 10601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:35.039384 10601 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:35.040803 10601 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:35.040886 10601 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:35.041011 10601 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:35.041070 10601 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:35.072732 10601 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:34263
I20260812 11:10:35.072795 10813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:34263 every 8 connection(s)
I20260812 11:10:35.074154 10601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:35.081175 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 10601
I20260812 11:10:35.081395 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:35.081861 4201 external_mini_cluster.cc:1428] Setting key 6a14281f090d245d83deaf754d01fd81
Aug 12 11:10:35 dist-test-slave-rmhg krb5kdc[10195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533034, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:35.098690 10818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:35.076941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:55143 (local address 127.4.26.126:46693)
0812 11:10:35.077408 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:35.077413 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:35.078553 (+ 1140us) server_negotiation.cc:407] Connection header received
0812 11:10:35.080502 (+ 1949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:35.080508 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:35.080683 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:35.080790 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:35.082814 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.083831 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.086363 (+ 2532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.086812 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.086919 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:35.091465 (+ 4546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:35.091471 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:35.091475 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:35.091514 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:35.095020 (+ 3506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:35.095980 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:35.095987 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:35.095991 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:35.096169 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:35.096641 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:35.096646 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:35.096650 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:35.097037 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:35.097228 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:35.098099 (+ 871us) server_negotiation.cc:299] Negotiation successful
0812 11:10:35.098342 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":252,"threads_started":1}
I20260812 11:10:35.099622 10819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:35.077499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:46693 (local address 127.4.26.66:55143)
0812 11:10:35.078353 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:35.078395 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:35.080164 (+ 1769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:35.081109 (+ 945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:35.081120 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:35.081822 (+ 702us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:35.082602 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:35.082633 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.084005 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.084010 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:35.086162 (+ 2152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:35.086184 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.087076 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.087083 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:35.087385 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:35.088168 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:35.088203 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:35.091123 (+ 2920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:35.095218 (+ 4095us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:35.095227 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:35.095244 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:35.095788 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:35.096298 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:35.096302 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:35.096304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:35.096517 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:35.097250 (+ 733us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:35.097258 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:35.097664 (+ 406us) client_negotiation.cc:769] Sending connection context
0812 11:10:35.097932 (+ 268us) client_negotiation.cc:240] Negotiation successful
0812 11:10:35.098392 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":351,"threads_started":1}
I20260812 11:10:35.101233 10814 heartbeater.cc:347] Connected to a master server at 127.4.26.126:46693
I20260812 11:10:35.101562 10814 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:35.102396 10814 heartbeater.cc:511] Master 127.4.26.126:46693 requested a full tablet report, sending...
I20260812 11:10:35.104072 10267 ts_manager.cc:194] Registered new tserver with Master: 2bf2969671324113a810122986623ce7 (127.4.26.66:34263)
I20260812 11:10:35.104951 10267 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:55143
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:10:35.136503 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:46693
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:36203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:35.488399 10823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:35.488749 10823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:35.488888 10823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:35.496382 10823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:35.496547 10823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:35.496701 10823 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:10:35.507009 10823 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:36203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:46693
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:35.508420 10823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:35.509944 10823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:35.524612 10834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:35.524681 10832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:35.524703 10831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:35.525547 10823 server_base.cc:1034] running on GCE node
I20260812 11:10:35.526262 10823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:35.527319 10823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:35.528570 10823 hybrid_clock.cc:648] HybridClock initialized: now 1786533035528494 us; error 66 us; skew 500 ppm
I20260812 11:10:35.528908 10823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:35 dist-test-slave-rmhg krb5kdc[10195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533035, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:35.532526 10823 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:10:35.534296 10823 webserver.cc:460] Webserver started at http://127.4.26.67:43125/ using document root <none> and password file <none>
I20260812 11:10:35.535142 10823 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:35.535264 10823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:35.535597 10823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:35.538965 10823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "6ebd83226c3c4e00a10bffb70b475c9e"
format_stamp: "Formatted at 2026-08-12 11:10:35 on dist-test-slave-rmhg"
server_key: "9299d762e2ac132f8510744cb08d524c"
server_key_iv: "ace0b556b3b310549791eb69d7482747"
server_key_version: "encryptionkey@0"
I20260812 11:10:35.539852 10823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "6ebd83226c3c4e00a10bffb70b475c9e"
format_stamp: "Formatted at 2026-08-12 11:10:35 on dist-test-slave-rmhg"
server_key: "9299d762e2ac132f8510744cb08d524c"
server_key_iv: "ace0b556b3b310549791eb69d7482747"
server_key_version: "encryptionkey@0"
I20260812 11:10:35.545809 10823 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 11:10:35.550000 10849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:35.550477 10589 heartbeater.cc:503] Master 127.4.26.126:46693 was elected leader, sending a full tablet report...
I20260812 11:10:35.551725 10823 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:10:35.551905 10823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "6ebd83226c3c4e00a10bffb70b475c9e"
format_stamp: "Formatted at 2026-08-12 11:10:35 on dist-test-slave-rmhg"
server_key: "9299d762e2ac132f8510744cb08d524c"
server_key_iv: "ace0b556b3b310549791eb69d7482747"
server_key_version: "encryptionkey@0"
I20260812 11:10:35.552145 10823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:35.575096 10823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:35.580143 10823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:35.580533 10823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:35.582001 10823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:35.583777 10823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:35.583881 10823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:35.584024 10823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:35.584084 10823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:35.616504 10823 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:38851
I20260812 11:10:35.616590 11025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:38851 every 8 connection(s)
I20260812 11:10:35.617959 10823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:35.620124 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 10823
I20260812 11:10:35.620335 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:35.620824 4201 external_mini_cluster.cc:1428] Setting key b8b3fd48c8863905af3a5e669aa77866
Aug 12 11:10:35 dist-test-slave-rmhg krb5kdc[10195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533035, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:35.639983 11028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:35.620963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:46195 (local address 127.4.26.126:46693)
0812 11:10:35.621515 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:35.621522 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:35.622615 (+ 1093us) server_negotiation.cc:407] Connection header received
0812 11:10:35.624781 (+ 2166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:35.624787 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:35.624884 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:35.625024 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:35.626775 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.627633 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.629391 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.629826 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.629928 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:35.633577 (+ 3649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:35.633584 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:35.633588 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:35.633634 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:35.636619 (+ 2985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:35.637545 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:35.637551 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:35.637554 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:35.637741 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:35.638279 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:35.638283 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:35.638285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:35.638612 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:35.638736 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:35.639452 (+ 716us) server_negotiation.cc:299] Negotiation successful
0812 11:10:35.639689 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":267,"threads_started":1}
I20260812 11:10:35.640988 11029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:35.621601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:46693 (local address 127.4.26.67:46195)
0812 11:10:35.622435 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:35.622495 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:35.624425 (+ 1930us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:35.625314 (+ 889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:35.625323 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:35.625970 (+ 647us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:35.626584 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:35.626604 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.627813 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.627818 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:35.629241 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:35.629258 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.630038 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.630043 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:35.630279 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:35.630981 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:35.631006 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:35.633306 (+ 2300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:35.636783 (+ 3477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:35.636795 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:35.636813 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:35.637403 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:35.637922 (+ 519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:35.637927 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:35.637929 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:35.638161 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:35.638717 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:35.638724 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:35.639088 (+ 364us) client_negotiation.cc:769] Sending connection context
0812 11:10:35.639337 (+ 249us) client_negotiation.cc:240] Negotiation successful
0812 11:10:35.639813 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":423,"threads_started":1}
I20260812 11:10:35.642508 11026 heartbeater.cc:347] Connected to a master server at 127.4.26.126:46693
I20260812 11:10:35.642844 11026 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:35.643641 11026 heartbeater.cc:511] Master 127.4.26.126:46693 requested a full tablet report, sending...
I20260812 11:10:35.645358 10267 ts_manager.cc:194] Registered new tserver with Master: 6ebd83226c3c4e00a10bffb70b475c9e (127.4.26.67:38851)
I20260812 11:10:35.646175 10267 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:46195
I20260812 11:10:35.650144 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:10:35 dist-test-slave-rmhg krb5kdc[10195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:10:35 dist-test-slave-rmhg krb5kdc[10195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:10:35.705195 11040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:35.688832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41760 (local address 127.4.26.65:45411)
0812 11:10:35.689489 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:35.689497 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:35.689526 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:10:35.689596 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:35.689603 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:35.689823 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:35.689954 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:35.691370 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.692447 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.693826 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.694430 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.694537 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:35.698613 (+ 4076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:35.698630 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:35.698649 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:35.698694 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:35.701787 (+ 3093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:35.702700 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:35.702709 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:35.702712 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:35.702871 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:35.703394 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:35.703399 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:35.703401 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:35.703867 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:35.704142 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:35.704540 (+ 398us) server_negotiation.cc:299] Negotiation successful
0812 11:10:35.704770 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":348,"threads_started":1}
Aug 12 11:10:35 dist-test-slave-rmhg krb5kdc[10195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:35.727416 11028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:35.710617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32904 (local address 127.4.26.126:46693)
0812 11:10:35.710867 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:35.710881 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:35.711105 (+ 224us) server_negotiation.cc:407] Connection header received
0812 11:10:35.711220 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:35.711224 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:35.711297 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:35.711388 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:35.713094 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.714017 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.715474 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.715966 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.716085 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:35.720662 (+ 4577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:35.720670 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:35.720673 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:35.720720 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:35.723658 (+ 2938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:35.724611 (+ 953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:35.724616 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:35.724619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:35.724785 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:35.725331 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:35.725336 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:35.725338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:35.725939 (+ 601us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:35.726260 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:35.726911 (+ 651us) server_negotiation.cc:299] Negotiation successful
0812 11:10:35.727153 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260812 11:10:35.728147 10267 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32904
I20260812 11:10:35.729624 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 10358
I20260812 11:10:35.744021 11040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:35.730809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41766 (local address 127.4.26.65:45411)
0812 11:10:35.731053 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:35.731058 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:35.731186 (+ 128us) server_negotiation.cc:407] Connection header received
0812 11:10:35.731283 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:35.731287 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:35.731390 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:35.731483 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:35.732824 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.733691 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.735071 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.735535 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.735660 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:35.738142 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:35.738148 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:35.738151 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:35.738192 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:35.741217 (+ 3025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:35.742040 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:35.742046 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:35.742048 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:35.742213 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:35.742595 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:35.742598 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:35.742601 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:35.742874 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:35.743067 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:35.743506 (+ 439us) server_negotiation.cc:299] Negotiation successful
0812 11:10:35.743702 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260812 11:10:35.744823 10577 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:35.829121 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 10358
I20260812 11:10:35.856877 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 10601
Aug 12 11:10:35 dist-test-slave-rmhg krb5kdc[10195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:10:35.876655 11046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:35.858141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49954 (local address 127.4.26.66:34263)
0812 11:10:35.858764 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:35.858773 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:35.858802 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:10:35.858878 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:35.858885 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:35.859122 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:35.859272 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:35.860660 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.862030 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.863640 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.864308 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.864461 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:35.869461 (+ 5000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:35.869481 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:35.869500 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:35.869547 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:35.873357 (+ 3810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:35.874262 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:35.874272 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:35.874275 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:35.874439 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:35.874886 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:35.874891 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:35.874894 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:35.875310 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:35.875645 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:35.875989 (+ 344us) server_negotiation.cc:299] Negotiation successful
0812 11:10:35.876288 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":338,"threads_started":1}
I20260812 11:10:35.878175 10808 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:35.961926 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 10601
I20260812 11:10:35.992013 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 10823
Aug 12 11:10:36 dist-test-slave-rmhg krb5kdc[10195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:10:36.016134 11048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:35.993201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50992 (local address 127.4.26.67:38851)
0812 11:10:35.993972 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:35.993984 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:35.994024 (+ 40us) server_negotiation.cc:407] Connection header received
0812 11:10:35.994102 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:35.994111 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:35.994376 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:35.994521 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:35.995921 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.997075 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.998618 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:35.999276 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:35.999387 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:36.009209 (+ 9822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:36.009233 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:36.009252 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:36.009305 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:36.012563 (+ 3258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:36.013547 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:36.013557 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:36.013560 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:36.013740 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:36.014262 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:36.014267 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:36.014269 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:36.014728 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:36.015027 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:36.015445 (+ 418us) server_negotiation.cc:299] Negotiation successful
0812 11:10:36.015729 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":345,"threads_started":1}
I20260812 11:10:36.017655 11019 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:36.103571 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 10823
I20260812 11:10:36.124290 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 10217
I20260812 11:10:36.125759 10308 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:36.231110 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 10217
2026-08-12T11:10:36Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4317 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:36 dist-test-slave-rmhg krb5kdc[11057](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:36 dist-test-slave-rmhg krb5kdc[11057](info): set up 2 sockets
Aug 12 11:10:36 dist-test-slave-rmhg krb5kdc[11057](info): commencing operation
krb5kdc: starting...
W20260812 11:10:37.491251 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.002s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:10:37 dist-test-slave-rmhg krb5kdc[11057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:10:37.724633 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37697
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:43087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:37697
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:38.089248 11075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:38.089576 11075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:38.089700 11075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:38.097579 11075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:38.097716 11075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:38.097774 11075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:38.097857 11075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:38.097919 11075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:38.108891 11075 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:43087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:37697
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:38.110412 11075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:38.111892 11075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:38.124984 11084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:38.125025 11082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:38.125061 11087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:38.125973 11075 server_base.cc:1034] running on GCE node
I20260812 11:10:38.126875 11075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:38.128628 11075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:38.129902 11075 hybrid_clock.cc:648] HybridClock initialized: now 1786533038129838 us; error 54 us; skew 500 ppm
I20260812 11:10:38.130338 11075 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:38 dist-test-slave-rmhg krb5kdc[11057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533038, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:38.134034 11075 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:10:38.135533 11075 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:38.135673 11075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:38.136040 11075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:38.139683 11075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "9590300e17274167b78705c1a1861088"
format_stamp: "Formatted at 2026-08-12 11:10:38 on dist-test-slave-rmhg"
server_key: "51077f9ffd27c27a507dc1183933bef2"
server_key_iv: "5c2f94b572c1122e287916b217eab59f"
server_key_version: "encryptionkey@0"
I20260812 11:10:38.140858 11075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "9590300e17274167b78705c1a1861088"
format_stamp: "Formatted at 2026-08-12 11:10:38 on dist-test-slave-rmhg"
server_key: "51077f9ffd27c27a507dc1183933bef2"
server_key_iv: "5c2f94b572c1122e287916b217eab59f"
server_key_version: "encryptionkey@0"
I20260812 11:10:38.147200 11075 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.001s
I20260812 11:10:38.151465 11096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:38.153062 11075 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:10:38.153306 11075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "9590300e17274167b78705c1a1861088"
format_stamp: "Formatted at 2026-08-12 11:10:38 on dist-test-slave-rmhg"
server_key: "51077f9ffd27c27a507dc1183933bef2"
server_key_iv: "5c2f94b572c1122e287916b217eab59f"
server_key_version: "encryptionkey@0"
I20260812 11:10:38.153569 11075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:38.178295 11075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:38.183106 11075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:38.183401 11075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:38.202904 11075 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:37697
I20260812 11:10:38.202924 11181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:37697 every 8 connection(s)
I20260812 11:10:38.203950 11075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:38.208271 11183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:38.209791 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 11075
I20260812 11:10:38.210026 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:10:38.210779 4201 external_mini_cluster.cc:1428] Setting key 7b2d55b5d70de8507a57eb32131994d8
I20260812 11:10:38.222942 11183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088: Bootstrap starting.
I20260812 11:10:38.226853 11183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088: Neither blocks nor log segments found. Creating new log.
Aug 12 11:10:38 dist-test-slave-rmhg krb5kdc[11057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:38.228030 11183 log.cc:824] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:38.231961 11183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088: No bootstrap required, opened a new log
I20260812 11:10:38.238394 11188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:38.213243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55194 (local address 127.4.26.126:37697)
0812 11:10:38.214216 (+ 973us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:38.214239 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:38.214301 (+ 62us) server_negotiation.cc:407] Connection header received
0812 11:10:38.216717 (+ 2416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:38.216756 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:38.217412 (+ 656us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:38.217914 (+ 502us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:38.219462 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:38.221669 (+ 2207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:38.223309 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:38.224396 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:38.224614 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:38.228889 (+ 4275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:38.228899 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:38.228918 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:38.228966 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:38.232964 (+ 3998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:38.233881 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:38.233892 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:38.233906 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:38.234151 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:38.234615 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:38.234621 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:38.234624 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:38.235475 (+ 851us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:38.235777 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:38.236288 (+ 511us) server_negotiation.cc:299] Negotiation successful
0812 11:10:38.236811 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":660,"thread_start_us":388,"threads_started":1}
I20260812 11:10:38.241931 11183 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9590300e17274167b78705c1a1861088" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37697 } }
I20260812 11:10:38.242353 11183 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:38.242439 11183 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9590300e17274167b78705c1a1861088, State: Initialized, Role: FOLLOWER
I20260812 11:10:38.242982 11183 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9590300e17274167b78705c1a1861088" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37697 } }
I20260812 11:10:38.243242 11183 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:38.243393 11183 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:38.243592 11183 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:38.246132 11183 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9590300e17274167b78705c1a1861088" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37697 } }
I20260812 11:10:38.246680 11183 leader_election.cc:302] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9590300e17274167b78705c1a1861088; no voters:
I20260812 11:10:38.247308 11183 leader_election.cc:288] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:38.247468 11193 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:38.248152 11193 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [term 1 LEADER]: Becoming Leader. State: Replica: 9590300e17274167b78705c1a1861088, State: Running, Role: LEADER
I20260812 11:10:38.248751 11193 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9590300e17274167b78705c1a1861088" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37697 } }
I20260812 11:10:38.249712 11183 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:38.251749 11196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9590300e17274167b78705c1a1861088. Latest consensus state: current_term: 1 leader_uuid: "9590300e17274167b78705c1a1861088" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9590300e17274167b78705c1a1861088" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37697 } } }
I20260812 11:10:38.252457 11196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:38.252249 11195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9590300e17274167b78705c1a1861088" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9590300e17274167b78705c1a1861088" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37697 } } }
I20260812 11:10:38.252689 11195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:38.258143 11206 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:38.264067 11206 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:38.274863 11206 catalog_manager.cc:1347] Generated new cluster ID: 0cf85806694b47b29a7ad3456f8391f1
I20260812 11:10:38.275000 11206 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:38.321293 11206 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:38.323411 11206 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:38.331554 11206 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088: Generated new TSK 0
I20260812 11:10:38.332801 11206 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:10:38.396602 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37697
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:43087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:38.749840 11227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:38.750160 11227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:38.750283 11227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:38.757863 11227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:38.758005 11227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:38.758183 11227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:10:38.768924 11227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:43087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37697
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:38.770382 11227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:38.771800 11227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:38.786197 11237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:38.786259 11234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:38.786237 11233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:38.787223 11227 server_base.cc:1034] running on GCE node
I20260812 11:10:38.787916 11227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:38.789005 11227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:38.790266 11227 hybrid_clock.cc:648] HybridClock initialized: now 1786533038790193 us; error 63 us; skew 500 ppm
I20260812 11:10:38.790660 11227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:38 dist-test-slave-rmhg krb5kdc[11057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533038, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:38.794303 11227 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:10:38.795696 11227 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:38.795814 11227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:38.796150 11227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:38.799634 11227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "26900d6787af4f9aafda8b4842ec9e9d"
format_stamp: "Formatted at 2026-08-12 11:10:38 on dist-test-slave-rmhg"
server_key: "0437bde4588ee5972e95f1fba9a5494c"
server_key_iv: "50336ffeab1f681cb0e61173e263ff43"
server_key_version: "encryptionkey@0"
I20260812 11:10:38.800724 11227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "26900d6787af4f9aafda8b4842ec9e9d"
format_stamp: "Formatted at 2026-08-12 11:10:38 on dist-test-slave-rmhg"
server_key: "0437bde4588ee5972e95f1fba9a5494c"
server_key_iv: "50336ffeab1f681cb0e61173e263ff43"
server_key_version: "encryptionkey@0"
I20260812 11:10:38.806905 11227 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.002s
I20260812 11:10:38.811185 11245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:38.813244 11227 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:10:38.813453 11227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "26900d6787af4f9aafda8b4842ec9e9d"
format_stamp: "Formatted at 2026-08-12 11:10:38 on dist-test-slave-rmhg"
server_key: "0437bde4588ee5972e95f1fba9a5494c"
server_key_iv: "50336ffeab1f681cb0e61173e263ff43"
server_key_version: "encryptionkey@0"
I20260812 11:10:38.813716 11227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:38.830041 11227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:38.834782 11227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:38.835099 11227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:38.836181 11227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:38.837774 11227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:38.837872 11227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:38.837985 11227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:38.838069 11227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:38.871584 11227 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:40157
I20260812 11:10:38.871716 11438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:40157 every 8 connection(s)
I20260812 11:10:38.872648 11227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:38.881474 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 11227
I20260812 11:10:38.881702 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:38.882454 4201 external_mini_cluster.cc:1428] Setting key 2e1d97ce72a4cfbd04bfdbd1838f6366
Aug 12 11:10:38 dist-test-slave-rmhg krb5kdc[11057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533038, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:38.895697 11441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:38.875362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:51127 (local address 127.4.26.126:37697)
0812 11:10:38.875934 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:38.875939 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:38.877022 (+ 1083us) server_negotiation.cc:407] Connection header received
0812 11:10:38.879092 (+ 2070us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:38.879097 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:38.879179 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:38.879288 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:38.881058 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:38.881961 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:38.884186 (+ 2225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:38.884876 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:38.884993 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:38.889676 (+ 4683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:38.889682 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:38.889686 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:38.889727 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:38.892196 (+ 2469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:38.893094 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:38.893101 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:38.893104 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:38.893285 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:38.893782 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:38.893786 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:38.893790 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:38.894164 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:38.894305 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:38.895085 (+ 780us) server_negotiation.cc:299] Negotiation successful
0812 11:10:38.895337 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":322,"threads_started":1}
I20260812 11:10:38.896674 11443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:38.876055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37697 (local address 127.4.26.65:51127)
0812 11:10:38.876833 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:38.876876 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:38.878712 (+ 1836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:38.879515 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:38.879524 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:38.880148 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:38.880812 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:38.880834 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:38.882170 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:38.882176 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:38.884010 (+ 1834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:38.884024 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:38.885284 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:38.885293 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:38.885619 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:38.886415 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:38.886456 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:38.889360 (+ 2904us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:38.892370 (+ 3010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:38.892381 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:38.892401 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:38.892955 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:38.893431 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:38.893435 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:38.893438 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:38.893663 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:38.894297 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:38.894304 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:38.894696 (+ 392us) client_negotiation.cc:769] Sending connection context
0812 11:10:38.894955 (+ 259us) client_negotiation.cc:240] Negotiation successful
0812 11:10:38.895428 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":297,"threads_started":1}
I20260812 11:10:38.898475 11439 heartbeater.cc:347] Connected to a master server at 127.4.26.126:37697
I20260812 11:10:38.898910 11439 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:38.899828 11439 heartbeater.cc:511] Master 127.4.26.126:37697 requested a full tablet report, sending...
I20260812 11:10:38.902324 11128 ts_manager.cc:194] Registered new tserver with Master: 26900d6787af4f9aafda8b4842ec9e9d (127.4.26.65:40157)
I20260812 11:10:38.903898 11128 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:51127
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:10:38.936410 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37697
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:43087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:39.282531 11447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:39.282891 11447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:39.283039 11447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:39.290740 11447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:39.290903 11447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:39.291071 11447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:10:39.301509 11447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:43087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37697
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:39.303000 11447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:39.304478 11447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:39.318890 11454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:39.318671 11455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:39.318811 11462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:39.320675 11447 server_base.cc:1034] running on GCE node
I20260812 11:10:39.321579 11447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:39.322671 11447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:39.323969 11447 hybrid_clock.cc:648] HybridClock initialized: now 1786533039323892 us; error 69 us; skew 500 ppm
I20260812 11:10:39.324368 11447 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:39 dist-test-slave-rmhg krb5kdc[11057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533039, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:39.328083 11447 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:10:39.329491 11447 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:39.329632 11447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:39.329989 11447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:39.333249 11447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "95c66d4973254e83a0c21a0caa5a3452"
format_stamp: "Formatted at 2026-08-12 11:10:39 on dist-test-slave-rmhg"
server_key: "702918d8a2413603c099e705c7da29df"
server_key_iv: "5b2f7a3b1f8b65e7cbb99d25bc08cef3"
server_key_version: "encryptionkey@0"
I20260812 11:10:39.334146 11447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "95c66d4973254e83a0c21a0caa5a3452"
format_stamp: "Formatted at 2026-08-12 11:10:39 on dist-test-slave-rmhg"
server_key: "702918d8a2413603c099e705c7da29df"
server_key_iv: "5b2f7a3b1f8b65e7cbb99d25bc08cef3"
server_key_version: "encryptionkey@0"
I20260812 11:10:39.339991 11447 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260812 11:10:39.344161 11469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:39.345966 11447 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:10:39.346167 11447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "95c66d4973254e83a0c21a0caa5a3452"
format_stamp: "Formatted at 2026-08-12 11:10:39 on dist-test-slave-rmhg"
server_key: "702918d8a2413603c099e705c7da29df"
server_key_iv: "5b2f7a3b1f8b65e7cbb99d25bc08cef3"
server_key_version: "encryptionkey@0"
I20260812 11:10:39.346400 11447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:39.382009 11447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:39.386775 11447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:39.387058 11447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:39.388091 11447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:39.389652 11447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:39.389767 11447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:39.389880 11447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:39.389950 11447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:39.424130 11447 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:41941
I20260812 11:10:39.424193 11648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:41941 every 8 connection(s)
I20260812 11:10:39.425297 11447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:39.430794 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 11447
I20260812 11:10:39.431018 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:39.431564 4201 external_mini_cluster.cc:1428] Setting key 5a0332f2886b1c29eab3cd2fedf003f5
Aug 12 11:10:39 dist-test-slave-rmhg krb5kdc[11057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533039, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:39.451285 11655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:39.428234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:36141 (local address 127.4.26.126:37697)
0812 11:10:39.428692 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:39.428697 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:39.429708 (+ 1011us) server_negotiation.cc:407] Connection header received
0812 11:10:39.432260 (+ 2552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:39.432267 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:39.432382 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:39.432559 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:39.434689 (+ 2130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:39.435525 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:39.437921 (+ 2396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:39.438426 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:39.438537 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:39.443188 (+ 4651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:39.443196 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:39.443201 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:39.443253 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:39.446884 (+ 3631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:39.447947 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:39.447954 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:39.447957 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:39.448146 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:39.448770 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:39.448775 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:39.448778 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:39.449263 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:39.449430 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:39.450521 (+ 1091us) server_negotiation.cc:299] Negotiation successful
0812 11:10:39.450848 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":233,"threads_started":1}
I20260812 11:10:39.452210 11660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:39.428694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37697 (local address 127.4.26.66:36141)
0812 11:10:39.429482 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:39.429526 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:39.431825 (+ 2299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:39.432892 (+ 1067us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:39.432903 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:39.433605 (+ 702us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:39.434461 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:39.434491 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:39.435711 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:39.435717 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:39.437705 (+ 1988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:39.437725 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:39.438690 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:39.438697 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:39.439070 (+ 373us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:39.439918 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:39.439951 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:39.442802 (+ 2851us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:39.447103 (+ 4301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:39.447113 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:39.447132 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:39.447765 (+ 633us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:39.448301 (+ 536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:39.448305 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:39.448308 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:39.448623 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:39.449450 (+ 827us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:39.449457 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:39.450028 (+ 571us) client_negotiation.cc:769] Sending connection context
0812 11:10:39.450368 (+ 340us) client_negotiation.cc:240] Negotiation successful
0812 11:10:39.450883 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":299,"threads_started":1}
I20260812 11:10:39.454038 11651 heartbeater.cc:347] Connected to a master server at 127.4.26.126:37697
I20260812 11:10:39.454376 11651 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:39.455109 11651 heartbeater.cc:511] Master 127.4.26.126:37697 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
I20260812 11:10:39.456863 11128 ts_manager.cc:194] Registered new tserver with Master: 95c66d4973254e83a0c21a0caa5a3452 (127.4.26.66:41941)
I20260812 11:10:39.457877 11128 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:36141
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:10:39.489133 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37697
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:43087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:39.844156 11668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:39.844489 11668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:39.844662 11668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:39.852615 11668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:39.852759 11668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:39.852881 11668 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:10:39.863595 11668 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:43087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37697
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:39.865018 11668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:39.866437 11668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:39.881129 11678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:39.881219 11676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:39.881218 11680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:39.881857 11668 server_base.cc:1034] running on GCE node
I20260812 11:10:39.882643 11668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:39.883711 11668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:39.884958 11668 hybrid_clock.cc:648] HybridClock initialized: now 1786533039884901 us; error 50 us; skew 500 ppm
I20260812 11:10:39.885370 11668 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:39 dist-test-slave-rmhg krb5kdc[11057](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533039, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:39.888864 11668 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:10:39.890188 11668 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:39.890296 11668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:39.890604 11668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:39.893826 11668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "5d08fd9a115e45a38710c5141ad6a10c"
format_stamp: "Formatted at 2026-08-12 11:10:39 on dist-test-slave-rmhg"
server_key: "cd87a8fdd82e84e55c39e5de35278b6c"
server_key_iv: "c9a9962cdb043bb06702abfa1c740694"
server_key_version: "encryptionkey@0"
I20260812 11:10:39.894714 11668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "5d08fd9a115e45a38710c5141ad6a10c"
format_stamp: "Formatted at 2026-08-12 11:10:39 on dist-test-slave-rmhg"
server_key: "cd87a8fdd82e84e55c39e5de35278b6c"
server_key_iv: "c9a9962cdb043bb06702abfa1c740694"
server_key_version: "encryptionkey@0"
I20260812 11:10:39.900328 11668 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:10:39.904592 11688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:39.906394 11668 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:10:39.906590 11668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "5d08fd9a115e45a38710c5141ad6a10c"
format_stamp: "Formatted at 2026-08-12 11:10:39 on dist-test-slave-rmhg"
server_key: "cd87a8fdd82e84e55c39e5de35278b6c"
server_key_iv: "c9a9962cdb043bb06702abfa1c740694"
server_key_version: "encryptionkey@0"
I20260812 11:10:39.906823 11668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:39.907557 11439 heartbeater.cc:503] Master 127.4.26.126:37697 was elected leader, sending a full tablet report...
I20260812 11:10:39.928201 11668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:39.932943 11668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:39.933283 11668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:39.934392 11668 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:39.935875 11668 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:39.935978 11668 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:39.936094 11668 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:39.936173 11668 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:39.970979 11668 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:43001
I20260812 11:10:39.971031 11878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:43001 every 8 connection(s)
I20260812 11:10:39.971890 11668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:39.973795 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 11668
I20260812 11:10:39.974001 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:39.974495 4201 external_mini_cluster.cc:1428] Setting key e7ad82d7f204aecf7613cff41f0da146
Aug 12 11:10:39 dist-test-slave-rmhg krb5kdc[11057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533039, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:39.993335 11883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:39.974678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:34547 (local address 127.4.26.126:37697)
0812 11:10:39.975202 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:39.975209 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:39.976379 (+ 1170us) server_negotiation.cc:407] Connection header received
0812 11:10:39.978560 (+ 2181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:39.978566 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:39.978646 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:39.978742 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:39.980340 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:39.981105 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:39.982842 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:39.983324 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:39.983434 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:39.987090 (+ 3656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:39.987096 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:39.987099 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:39.987148 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:39.990183 (+ 3035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:39.990978 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:39.990982 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:39.990985 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:39.991133 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:39.991507 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:39.991511 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:39.991512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:39.991785 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:39.991903 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:39.992771 (+ 868us) server_negotiation.cc:299] Negotiation successful
0812 11:10:39.992981 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":221,"threads_started":1}
I20260812 11:10:39.994342 11886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:39.975310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37697 (local address 127.4.26.67:34547)
0812 11:10:39.976205 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:39.976259 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:39.978287 (+ 2028us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:39.978953 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:39.978962 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:39.979511 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:39.980136 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:39.980161 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:39.981277 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:39.981281 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:39.982625 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:39.982647 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:39.983520 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:39.983525 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:39.983773 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:39.984408 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:39.984444 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:39.986827 (+ 2383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:39.990340 (+ 3513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:39.990351 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:39.990372 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:39.990881 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:39.991232 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:39.991236 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:39.991238 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:39.991430 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:39.991955 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:39.991963 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:39.992347 (+ 384us) client_negotiation.cc:769] Sending connection context
0812 11:10:39.992655 (+ 308us) client_negotiation.cc:240] Negotiation successful
0812 11:10:39.993112 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":377,"threads_started":1}
I20260812 11:10:39.995929 11879 heartbeater.cc:347] Connected to a master server at 127.4.26.126:37697
I20260812 11:10:39.996261 11879 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:39.996973 11879 heartbeater.cc:511] Master 127.4.26.126:37697 requested a full tablet report, sending...
I20260812 11:10:39.998689 11128 ts_manager.cc:194] Registered new tserver with Master: 5d08fd9a115e45a38710c5141ad6a10c (127.4.26.67:43001)
I20260812 11:10:39.999547 11128 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:34547
I20260812 11:10:40.003260 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:10:40.022305 11883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:40.008190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39846 (local address 127.4.26.126:37697)
0812 11:10:40.008403 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:40.008409 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:40.008995 (+ 586us) server_negotiation.cc:407] Connection header received
0812 11:10:40.009117 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:40.009121 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:40.009233 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:40.009333 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:40.010982 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.011833 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.013338 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.013833 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.013947 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:40.016422 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:40.016428 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:40.016431 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:40.016473 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:40.019512 (+ 3039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:40.020328 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:40.020333 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:40.020335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:40.020480 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:40.020880 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:40.020883 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:40.020885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:40.021292 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:40.021481 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:40.021801 (+ 320us) server_negotiation.cc:299] Negotiation successful
0812 11:10:40.021994 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 11:10:40.026846 11128 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39846:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:10:40.033979 11128 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:40.073841 11905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:40.048257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47572 (local address 127.4.26.65:40157)
0812 11:10:40.063705 (+ 15448us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:40.063716 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:40.064628 (+ 912us) server_negotiation.cc:407] Connection header received
0812 11:10:40.065010 (+ 382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:40.065019 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:40.065350 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:40.065580 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:40.066577 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.068071 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.070737 (+ 2666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.072324 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.072467 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:40.072742 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:40.073275 (+ 533us) server_negotiation.cc:299] Negotiation successful
0812 11:10:40.073477 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15214,"thread_start_us":15462,"threads_started":1}
I20260812 11:10:40.074270 11900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:40.047735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:43001 (local address 127.0.0.1:36264)
0812 11:10:40.062466 (+ 14731us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:40.062530 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:40.062810 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:40.066791 (+ 3981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:40.066796 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:40.066823 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:40.067249 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:40.067262 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.069191 (+ 1929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.069196 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:40.071172 (+ 1976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:40.071191 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.073071 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.073078 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:40.073286 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:40.073322 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:10:40.073406 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 11:10:40.073549 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14367,"mutex_wait_us":42,"thread_start_us":15321,"threads_started":1}
I20260812 11:10:40.074581 11903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:40.047909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36264 (local address 127.4.26.67:43001)
0812 11:10:40.065868 (+ 17959us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:40.065877 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:40.065914 (+ 37us) server_negotiation.cc:407] Connection header received
0812 11:10:40.066010 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:40.066031 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:40.066304 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:40.066533 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:40.067464 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.069039 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.071402 (+ 2363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.072848 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.072969 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:40.073245 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:40.073474 (+ 229us) server_negotiation.cc:299] Negotiation successful
0812 11:10:40.073648 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17779,"thread_start_us":17631,"threads_started":1}
I20260812 11:10:40.074846 11904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:40.047889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:40157 (local address 127.0.0.1:47572)
0812 11:10:40.064451 (+ 16562us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:40.064475 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:40.064770 (+ 295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:40.065952 (+ 1182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:40.065959 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:40.065992 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:40.066369 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:40.066382 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.068272 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.068277 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:40.070504 (+ 2227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:40.070531 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.072572 (+ 2041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.072580 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:40.072795 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:40.072858 (+ 63us) client_negotiation.cc:769] Sending connection context
0812 11:10:40.073012 (+ 154us) client_negotiation.cc:240] Negotiation successful
0812 11:10:40.074127 (+ 1115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16401,"mutex_wait_us":4,"thread_start_us":16233,"threads_started":1}
I20260812 11:10:40.074973 11909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:40.050561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:41941 (local address 127.0.0.1:41588)
0812 11:10:40.065425 (+ 14864us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:40.065444 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:40.065564 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:40.066551 (+ 987us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:40.066556 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:40.066579 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:40.067047 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:40.067063 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.069112 (+ 2049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.069118 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:40.071449 (+ 2331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:40.071464 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.073321 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.073328 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:40.073511 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:40.073552 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 11:10:40.073622 (+ 70us) client_negotiation.cc:240] Negotiation successful
0812 11:10:40.073757 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14738,"mutex_wait_us":83,"thread_start_us":14589,"threads_started":1}
I20260812 11:10:40.075042 11910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:40.050880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41588 (local address 127.4.26.66:41941)
0812 11:10:40.066011 (+ 15131us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:40.066019 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:40.066048 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:10:40.066155 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:40.066160 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:40.066335 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:40.066522 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:40.067318 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.068942 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.071650 (+ 2708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.073071 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.074214 (+ 1143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:40.074446 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:40.074523 (+ 77us) server_negotiation.cc:299] Negotiation successful
0812 11:10:40.074704 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14990,"thread_start_us":14889,"threads_started":1}
I20260812 11:10:40.079167 11547 tablet_service.cc:1467] Processing CreateTablet for tablet 71b5d493bdc841358b29d1719f3a045c (DEFAULT_TABLE table=test-table [id=98f464c1085240bf84a17e3af2e7b29e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:40.079217 11758 tablet_service.cc:1467] Processing CreateTablet for tablet 71b5d493bdc841358b29d1719f3a045c (DEFAULT_TABLE table=test-table [id=98f464c1085240bf84a17e3af2e7b29e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:40.079216 11333 tablet_service.cc:1467] Processing CreateTablet for tablet 71b5d493bdc841358b29d1719f3a045c (DEFAULT_TABLE table=test-table [id=98f464c1085240bf84a17e3af2e7b29e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:40.080559 11547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71b5d493bdc841358b29d1719f3a045c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:40.080621 11758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71b5d493bdc841358b29d1719f3a045c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:40.080633 11333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71b5d493bdc841358b29d1719f3a045c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:40.092485 11911 tablet_bootstrap.cc:492] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452: Bootstrap starting.
I20260812 11:10:40.095578 11916 tablet_bootstrap.cc:492] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d: Bootstrap starting.
I20260812 11:10:40.098228 11911 tablet_bootstrap.cc:654] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:40.099269 11916 tablet_bootstrap.cc:654] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:40.099673 11911 log.cc:824] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:40.100255 11917 tablet_bootstrap.cc:492] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c: Bootstrap starting.
I20260812 11:10:40.100551 11916 log.cc:824] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:40.103677 11911 tablet_bootstrap.cc:492] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452: No bootstrap required, opened a new log
I20260812 11:10:40.103820 11917 tablet_bootstrap.cc:654] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:40.103997 11911 ts_tablet_manager.cc:1397] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.006s
I20260812 11:10:40.104305 11916 tablet_bootstrap.cc:492] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d: No bootstrap required, opened a new log
I20260812 11:10:40.104655 11916 ts_tablet_manager.cc:1397] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.009s
I20260812 11:10:40.105082 11917 log.cc:824] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:40.108047 11917 tablet_bootstrap.cc:492] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c: No bootstrap required, opened a new log
I20260812 11:10:40.108322 11917 ts_tablet_manager.cc:1397] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 11:10:40.115458 11916 raft_consensus.cc:348] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d08fd9a115e45a38710c5141ad6a10c" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43001 } } peers { permanent_uuid: "26900d6787af4f9aafda8b4842ec9e9d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40157 } } peers { permanent_uuid: "95c66d4973254e83a0c21a0caa5a3452" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41941 } }
I20260812 11:10:40.115458 11911 raft_consensus.cc:348] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d08fd9a115e45a38710c5141ad6a10c" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43001 } } peers { permanent_uuid: "26900d6787af4f9aafda8b4842ec9e9d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40157 } } peers { permanent_uuid: "95c66d4973254e83a0c21a0caa5a3452" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41941 } }
I20260812 11:10:40.115978 11916 raft_consensus.cc:374] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:40.115986 11911 raft_consensus.cc:374] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:40.116087 11916 raft_consensus.cc:729] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26900d6787af4f9aafda8b4842ec9e9d, State: Initialized, Role: FOLLOWER
I20260812 11:10:40.116170 11917 raft_consensus.cc:348] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d08fd9a115e45a38710c5141ad6a10c" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43001 } } peers { permanent_uuid: "26900d6787af4f9aafda8b4842ec9e9d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40157 } } peers { permanent_uuid: "95c66d4973254e83a0c21a0caa5a3452" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41941 } }
I20260812 11:10:40.116091 11911 raft_consensus.cc:729] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95c66d4973254e83a0c21a0caa5a3452, State: Initialized, Role: FOLLOWER
I20260812 11:10:40.116706 11917 raft_consensus.cc:374] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:40.116813 11917 raft_consensus.cc:729] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d08fd9a115e45a38710c5141ad6a10c, State: Initialized, Role: FOLLOWER
I20260812 11:10:40.116815 11916 consensus_queue.cc:260] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d08fd9a115e45a38710c5141ad6a10c" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43001 } } peers { permanent_uuid: "26900d6787af4f9aafda8b4842ec9e9d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40157 } } peers { permanent_uuid: "95c66d4973254e83a0c21a0caa5a3452" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41941 } }
I20260812 11:10:40.117339 11911 consensus_queue.cc:260] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d08fd9a115e45a38710c5141ad6a10c" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43001 } } peers { permanent_uuid: "26900d6787af4f9aafda8b4842ec9e9d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40157 } } peers { permanent_uuid: "95c66d4973254e83a0c21a0caa5a3452" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41941 } }
I20260812 11:10:40.117554 11917 consensus_queue.cc:260] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d08fd9a115e45a38710c5141ad6a10c" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43001 } } peers { permanent_uuid: "26900d6787af4f9aafda8b4842ec9e9d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40157 } } peers { permanent_uuid: "95c66d4973254e83a0c21a0caa5a3452" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41941 } }
I20260812 11:10:40.118841 11916 ts_tablet_manager.cc:1428] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d: Time spent starting tablet: real 0.014s user 0.007s sys 0.006s
I20260812 11:10:40.119849 11651 heartbeater.cc:503] Master 127.4.26.126:37697 was elected leader, sending a full tablet report...
I20260812 11:10:40.120360 11879 heartbeater.cc:503] Master 127.4.26.126:37697 was elected leader, sending a full tablet report...
I20260812 11:10:40.121348 11917 ts_tablet_manager.cc:1428] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260812 11:10:40.122139 11911 ts_tablet_manager.cc:1428] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452: Time spent starting tablet: real 0.018s user 0.008s sys 0.010s
W20260812 11:10:40.125172 11440 tablet.cc:2369] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:10:40.177577 11654 tablet.cc:2369] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:10:40.223415 11882 tablet.cc:2369] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:40.301007 11926 raft_consensus.cc:482] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:40.301357 11926 raft_consensus.cc:504] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d08fd9a115e45a38710c5141ad6a10c" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43001 } } peers { permanent_uuid: "26900d6787af4f9aafda8b4842ec9e9d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40157 } } peers { permanent_uuid: "95c66d4973254e83a0c21a0caa5a3452" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41941 } }
I20260812 11:10:40.303289 11926 leader_election.cc:288] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26900d6787af4f9aafda8b4842ec9e9d (127.4.26.65:40157), 95c66d4973254e83a0c21a0caa5a3452 (127.4.26.66:41941)
I20260812 11:10:40.309909 11886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:40.303795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:41941 (local address 127.4.26.67:52311)
0812 11:10:40.304114 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:40.304136 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:40.304278 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:40.304699 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:40.304704 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:40.304743 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:40.305056 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:40.305069 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.306410 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.306413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:40.308084 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:40.308101 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.309307 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.309312 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:40.309457 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:40.309483 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:10:40.309560 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 11:10:40.309676 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":26}
I20260812 11:10:40.310022 11910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:40.303982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:52311 (local address 127.4.26.66:41941)
0812 11:10:40.304211 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:40.304219 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:40.304246 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:10:40.304467 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:40.304473 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:40.304546 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:40.304650 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:40.305295 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.306304 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.308288 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.309112 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.309302 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:40.309414 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:40.309609 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 11:10:40.309754 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 11:10:40.311282 11905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:40.304088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:50391 (local address 127.4.26.65:40157)
0812 11:10:40.304279 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:40.304285 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:40.305466 (+ 1181us) server_negotiation.cc:407] Connection header received
0812 11:10:40.305716 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:40.305722 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:40.305808 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:40.305905 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:40.306413 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.307150 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.309224 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.310401 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.310555 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:40.310673 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:40.310977 (+ 304us) server_negotiation.cc:299] Negotiation successful
0812 11:10:40.311091 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 11:10:40.311254 11577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71b5d493bdc841358b29d1719f3a045c" candidate_uuid: "5d08fd9a115e45a38710c5141ad6a10c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c66d4973254e83a0c21a0caa5a3452" is_pre_election: true
I20260812 11:10:40.311513 11927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:40.304417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:40157 (local address 127.4.26.67:50391)
0812 11:10:40.305356 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:40.305377 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:40.305510 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:40.305921 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:40.305924 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:40.305946 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:40.306234 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:40.306243 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.307312 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.307318 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:40.308992 (+ 1674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:40.309005 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.310625 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.310632 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:40.310808 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:40.310844 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:10:40.310949 (+ 105us) client_negotiation.cc:240] Negotiation successful
0812 11:10:40.311103 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":813,"mutex_wait_us":1,"thread_start_us":551,"threads_started":1}
I20260812 11:10:40.311909 11577 raft_consensus.cc:2454] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d08fd9a115e45a38710c5141ad6a10c in term 0.
I20260812 11:10:40.312605 11699 leader_election.cc:302] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d08fd9a115e45a38710c5141ad6a10c, 95c66d4973254e83a0c21a0caa5a3452; no voters:
I20260812 11:10:40.312604 11362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71b5d493bdc841358b29d1719f3a045c" candidate_uuid: "5d08fd9a115e45a38710c5141ad6a10c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26900d6787af4f9aafda8b4842ec9e9d" is_pre_election: true
I20260812 11:10:40.313001 11926 raft_consensus.cc:2781] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:40.313174 11926 raft_consensus.cc:482] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:40.313113 11362 raft_consensus.cc:2454] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d08fd9a115e45a38710c5141ad6a10c in term 0.
I20260812 11:10:40.313292 11926 raft_consensus.cc:3037] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:40.315567 11926 raft_consensus.cc:504] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d08fd9a115e45a38710c5141ad6a10c" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43001 } } peers { permanent_uuid: "26900d6787af4f9aafda8b4842ec9e9d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40157 } } peers { permanent_uuid: "95c66d4973254e83a0c21a0caa5a3452" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41941 } }
I20260812 11:10:40.316221 11926 leader_election.cc:288] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [CANDIDATE]: Term 1 election: Requested vote from peers 26900d6787af4f9aafda8b4842ec9e9d (127.4.26.65:40157), 95c66d4973254e83a0c21a0caa5a3452 (127.4.26.66:41941)
I20260812 11:10:40.316771 11362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71b5d493bdc841358b29d1719f3a045c" candidate_uuid: "5d08fd9a115e45a38710c5141ad6a10c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26900d6787af4f9aafda8b4842ec9e9d"
I20260812 11:10:40.316826 11577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71b5d493bdc841358b29d1719f3a045c" candidate_uuid: "5d08fd9a115e45a38710c5141ad6a10c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95c66d4973254e83a0c21a0caa5a3452"
I20260812 11:10:40.316972 11362 raft_consensus.cc:3037] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:40.317052 11577 raft_consensus.cc:3037] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:40.319442 11362 raft_consensus.cc:2454] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d08fd9a115e45a38710c5141ad6a10c in term 1.
I20260812 11:10:40.319856 11577 raft_consensus.cc:2454] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d08fd9a115e45a38710c5141ad6a10c in term 1.
I20260812 11:10:40.319984 11693 leader_election.cc:302] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26900d6787af4f9aafda8b4842ec9e9d, 5d08fd9a115e45a38710c5141ad6a10c; no voters:
I20260812 11:10:40.320382 11926 raft_consensus.cc:2781] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:40.320910 11926 raft_consensus.cc:686] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [term 1 LEADER]: Becoming Leader. State: Replica: 5d08fd9a115e45a38710c5141ad6a10c, State: Running, Role: LEADER
I20260812 11:10:40.321492 11926 consensus_queue.cc:237] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d08fd9a115e45a38710c5141ad6a10c" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43001 } } peers { permanent_uuid: "26900d6787af4f9aafda8b4842ec9e9d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40157 } } peers { permanent_uuid: "95c66d4973254e83a0c21a0caa5a3452" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41941 } }
I20260812 11:10:40.326572 11124 catalog_manager.cc:5495] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d08fd9a115e45a38710c5141ad6a10c (127.4.26.67). New cstate: current_term: 1 leader_uuid: "5d08fd9a115e45a38710c5141ad6a10c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d08fd9a115e45a38710c5141ad6a10c" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 43001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26900d6787af4f9aafda8b4842ec9e9d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95c66d4973254e83a0c21a0caa5a3452" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41941 } health_report { overall_health: UNKNOWN } } }
I20260812 11:10:40.377015 11903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:40.371018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36266 (local address 127.4.26.67:43001)
0812 11:10:40.371204 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:40.371209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:40.371321 (+ 112us) server_negotiation.cc:407] Connection header received
0812 11:10:40.371507 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:40.371511 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:40.371594 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:40.371729 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:10:40.372208 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.373046 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.374568 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.375004 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.375116 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:40.375724 (+ 608us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:10:40.376387 (+ 663us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:10:40.376579 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:40.376636 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 11:10:40.376731 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:10:40.387015 11362 raft_consensus.cc:1261] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d [term 1 FOLLOWER]: Refusing update from remote peer 5d08fd9a115e45a38710c5141ad6a10c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:40.388247 11928 consensus_queue.cc:1035] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [LEADER]: Connected to new peer: Peer: permanent_uuid: "26900d6787af4f9aafda8b4842ec9e9d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 40157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:40.388440 11577 raft_consensus.cc:1261] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452 [term 1 FOLLOWER]: Refusing update from remote peer 5d08fd9a115e45a38710c5141ad6a10c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:40.389509 11928 consensus_queue.cc:1035] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95c66d4973254e83a0c21a0caa5a3452" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:40.415660 11124 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39846:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:40.415982 11124 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39846:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:40.419987 11124 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9590300e17274167b78705c1a1861088: Sending DeleteTablet for 3 replicas of tablet 71b5d493bdc841358b29d1719f3a045c
I20260812 11:10:40.421298 11333 tablet_service.cc:1514] Processing DeleteTablet for tablet 71b5d493bdc841358b29d1719f3a045c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:40 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:47572
I20260812 11:10:40.421427 11547 tablet_service.cc:1514] Processing DeleteTablet for tablet 71b5d493bdc841358b29d1719f3a045c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:40 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:41588
I20260812 11:10:40.421794 11758 tablet_service.cc:1514] Processing DeleteTablet for tablet 71b5d493bdc841358b29d1719f3a045c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:40 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:36264
I20260812 11:10:40.424003 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 11227
I20260812 11:10:40.450644 11948 tablet_replica.cc:330] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c: stopping tablet replica
I20260812 11:10:40.451414 11948 raft_consensus.cc:2229] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:10:40.452191 11948 raft_consensus.cc:2258] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:40.454715 11948 ts_tablet_manager.cc:1905] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:40.456408 11946 tablet_replica.cc:330] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452: stopping tablet replica
I20260812 11:10:40.456835 11946 raft_consensus.cc:2229] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:40.457409 11946 raft_consensus.cc:2258] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:40.463197 11948 ts_tablet_manager.cc:1918] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:40.463421 11948 log.cc:1196] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/71b5d493bdc841358b29d1719f3a045c
I20260812 11:10:40.464048 11948 ts_tablet_manager.cc:1939] T 71b5d493bdc841358b29d1719f3a045c P 5d08fd9a115e45a38710c5141ad6a10c: Deleting consensus metadata
Aug 12 11:10:40 dist-test-slave-rmhg krb5kdc[11057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:10:40.466358 11097 catalog_manager.cc:4841] TS 5d08fd9a115e45a38710c5141ad6a10c (127.4.26.67:43001): tablet 71b5d493bdc841358b29d1719f3a045c (table test-table [id=98f464c1085240bf84a17e3af2e7b29e]) successfully deleted
I20260812 11:10:40.466989 11946 ts_tablet_manager.cc:1905] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:40.469781 11947 tablet_replica.cc:330] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d: stopping tablet replica
I20260812 11:10:40.470350 11947 raft_consensus.cc:2229] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:40.470974 11947 raft_consensus.cc:2258] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:40.474148 11947 ts_tablet_manager.cc:1905] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:40.474421 11946 ts_tablet_manager.cc:1918] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:40.474622 11946 log.cc:1196] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/71b5d493bdc841358b29d1719f3a045c
I20260812 11:10:40.475301 11946 ts_tablet_manager.cc:1939] T 71b5d493bdc841358b29d1719f3a045c P 95c66d4973254e83a0c21a0caa5a3452: Deleting consensus metadata
I20260812 11:10:40.477892 11102 catalog_manager.cc:4841] TS 95c66d4973254e83a0c21a0caa5a3452 (127.4.26.66:41941): tablet 71b5d493bdc841358b29d1719f3a045c (table test-table [id=98f464c1085240bf84a17e3af2e7b29e]) successfully deleted
I20260812 11:10:40.480481 11947 ts_tablet_manager.cc:1918] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:40.480686 11947 log.cc:1196] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/71b5d493bdc841358b29d1719f3a045c
I20260812 11:10:40.481370 11947 ts_tablet_manager.cc:1939] T 71b5d493bdc841358b29d1719f3a045c P 26900d6787af4f9aafda8b4842ec9e9d: Deleting consensus metadata
I20260812 11:10:40.483421 11099 catalog_manager.cc:4841] TS 26900d6787af4f9aafda8b4842ec9e9d (127.4.26.65:40157): tablet 71b5d493bdc841358b29d1719f3a045c (table test-table [id=98f464c1085240bf84a17e3af2e7b29e]) successfully deleted
I20260812 11:10:40.488118 11905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:40.425603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47574 (local address 127.4.26.65:40157)
0812 11:10:40.429360 (+ 3757us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:40.429368 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:40.448569 (+ 19201us) server_negotiation.cc:407] Connection header received
0812 11:10:40.448773 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:40.448780 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:40.448904 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:40.449038 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:40.451345 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.452644 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.458336 (+ 5692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.459119 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.459252 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:40.481020 (+ 21768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:40.481040 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:40.481061 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:40.481109 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:40.484899 (+ 3790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:40.486078 (+ 1179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:40.486087 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:40.486090 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:40.486268 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:40.486700 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:40.486704 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:40.486706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:40.487068 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:40.487326 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:40.487636 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 11:10:40.487821 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3582}
I20260812 11:10:40.488845 11433 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:40.585616 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 11227
I20260812 11:10:40.610828 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 11447
Aug 12 11:10:40 dist-test-slave-rmhg krb5kdc[11057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:10:40.628995 11910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:40.611689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41594 (local address 127.4.26.66:41941)
0812 11:10:40.611882 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:40.611888 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:40.611911 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:10:40.612069 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:40.612074 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:40.612178 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:40.612297 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:40.613738 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.614943 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.616348 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.617007 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.617302 (+ 295us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:40.621844 (+ 4542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:40.621867 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:40.621892 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:40.621947 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:40.625920 (+ 3973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:40.626788 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:40.626798 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:40.626802 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:40.626993 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:40.627367 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:40.627371 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:40.627375 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:40.627863 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:40.628151 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:40.628401 (+ 250us) server_negotiation.cc:299] Negotiation successful
0812 11:10:40.628640 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 11:10:40.629776 11643 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:40.721828 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 11447
I20260812 11:10:40.748586 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 11668
Aug 12 11:10:40 dist-test-slave-rmhg krb5kdc[11057](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:10:40.766541 11903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:40.749627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36274 (local address 127.4.26.67:43001)
0812 11:10:40.749829 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:40.749836 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:40.749856 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:10:40.749920 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:40.749923 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:40.749995 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:40.750086 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:40.751421 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.752354 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.753715 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:40.754167 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:40.754297 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:40.759351 (+ 5054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:40.759368 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:40.759387 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:40.759434 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:40.763156 (+ 3722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:40.764043 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:40.764053 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:40.764055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:40.764253 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:40.764718 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:40.764723 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:40.764725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:40.765136 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:40.765524 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:40.765884 (+ 360us) server_negotiation.cc:299] Negotiation successful
0812 11:10:40.766139 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:10:40.767388 11874 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:40.892040 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 11668
I20260812 11:10:40.918326 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 11075
I20260812 11:10:40.919667 11174 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:41.030426 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 11075
2026-08-12T11:10:41Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4797 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-12T11:10:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:41Z Disabled control of system clock
I20260812 11:10:41.114348 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:33449
--webserver_interface=127.4.26.126
--webserver_port=0
--builtin_ntp_servers=127.4.26.84:42093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:33449
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 11:10:41.472554 11961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:41.472898 11961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:41.472987 11961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:41.480464 11961 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:41.480589 11961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:41.480626 11961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:41.480690 11961 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:41.480736 11961 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:41.490402 11961 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:42093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:33449
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:33449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:41.491743 11961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:41.493579 11961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:41.505870 11976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:41.505898 11972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:41.505928 11969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:41.506858 11961 server_base.cc:1034] running on GCE node
I20260812 11:10:41.507714 11961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:41.509331 11961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:41.510599 11961 hybrid_clock.cc:648] HybridClock initialized: now 1786533041510540 us; error 60 us; skew 500 ppm
I20260812 11:10:41.510982 11961 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:10:41.517679 11961 webserver.cc:460] Webserver started at http://127.4.26.126:40427/ using document root <none> and password file <none>
I20260812 11:10:41.518491 11961 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:41.518615 11961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:41.518983 11961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:41.522323 11961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "5882cd228454422ab69fc3a78dead0b4"
format_stamp: "Formatted at 2026-08-12 11:10:41 on dist-test-slave-rmhg"
server_key: "f0c441ec7a8b240dda2c8c11366d7467"
server_key_iv: "29d08fcc30dcc048b2699690775bb274"
server_key_version: "encryptionkey@0"
I20260812 11:10:41.523213 11961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "5882cd228454422ab69fc3a78dead0b4"
format_stamp: "Formatted at 2026-08-12 11:10:41 on dist-test-slave-rmhg"
server_key: "f0c441ec7a8b240dda2c8c11366d7467"
server_key_iv: "29d08fcc30dcc048b2699690775bb274"
server_key_version: "encryptionkey@0"
I20260812 11:10:41.529119 11961 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:10:41.533037 11985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:41.534667 11961 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:10:41.534866 11961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "5882cd228454422ab69fc3a78dead0b4"
format_stamp: "Formatted at 2026-08-12 11:10:41 on dist-test-slave-rmhg"
server_key: "f0c441ec7a8b240dda2c8c11366d7467"
server_key_iv: "29d08fcc30dcc048b2699690775bb274"
server_key_version: "encryptionkey@0"
I20260812 11:10:41.535097 11961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:41.541429 11961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:41.542308 11961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:41.542623 11961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:41.560920 11961 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:33449
I20260812 11:10:41.560959 12075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:33449 every 8 connection(s)
I20260812 11:10:41.562433 11961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:41.566596 12077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:41.568856 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 11961
I20260812 11:10:41.569074 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:10:41.569790 4201 external_mini_cluster.cc:1428] Setting key daee6bc650a10e27f006a63b1c475e4d
I20260812 11:10:41.580858 12081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:41.572235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48350 (local address 127.4.26.126:33449)
0812 11:10:41.573529 (+ 1294us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:41.573548 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:41.573608 (+ 60us) server_negotiation.cc:407] Connection header received
0812 11:10:41.576072 (+ 2464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:41.576124 (+ 52us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:41.576849 (+ 725us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:41.577444 (+ 595us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:41.578622 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:41.578632 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:41.578651 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:41.578677 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:41.578771 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:41.578794 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:41.579028 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:41.579177 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 11:10:41.579491 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":387,"threads_started":1}
I20260812 11:10:41.581167 12077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4: Bootstrap starting.
I20260812 11:10:41.584821 12077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:41.585963 12077 log.cc:824] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:41.589396 12077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4: No bootstrap required, opened a new log
I20260812 11:10:41.597824 12077 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5882cd228454422ab69fc3a78dead0b4" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33449 } }
I20260812 11:10:41.598277 12077 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:41.598384 12077 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5882cd228454422ab69fc3a78dead0b4, State: Initialized, Role: FOLLOWER
I20260812 11:10:41.599031 12077 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5882cd228454422ab69fc3a78dead0b4" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33449 } }
I20260812 11:10:41.599282 12077 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:41.599422 12077 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:41.599606 12077 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:41.602293 12077 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5882cd228454422ab69fc3a78dead0b4" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33449 } }
I20260812 11:10:41.602978 12077 leader_election.cc:302] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5882cd228454422ab69fc3a78dead0b4; no voters:
I20260812 11:10:41.603578 12077 leader_election.cc:288] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:41.603724 12085 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:41.604401 12085 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [term 1 LEADER]: Becoming Leader. State: Replica: 5882cd228454422ab69fc3a78dead0b4, State: Running, Role: LEADER
I20260812 11:10:41.605024 12085 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5882cd228454422ab69fc3a78dead0b4" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33449 } }
I20260812 11:10:41.605806 12077 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:41.607723 12086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5882cd228454422ab69fc3a78dead0b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5882cd228454422ab69fc3a78dead0b4" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33449 } } }
I20260812 11:10:41.608161 12086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:41.608063 12088 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5882cd228454422ab69fc3a78dead0b4. Latest consensus state: current_term: 1 leader_uuid: "5882cd228454422ab69fc3a78dead0b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5882cd228454422ab69fc3a78dead0b4" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33449 } } }
I20260812 11:10:41.608381 12088 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:41.610677 12099 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:41.616317 12099 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:41.625814 12099 catalog_manager.cc:1347] Generated new cluster ID: 49897bd57c16459a9167dcf8eace6f0a
I20260812 11:10:41.625959 12099 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:41.651512 12099 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:41.652038 12099 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:41.661720 12099 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4: Generated new TSK 0
I20260812 11:10:41.662698 12099 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:41.675168 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33449
--builtin_ntp_servers=127.4.26.84:42093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260812 11:10:42.031755 12114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:42.032066 12114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:42.032209 12114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:42.039978 12114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:42.040100 12114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:42.040257 12114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:10:42.050012 12114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:42093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33449
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:42.051406 12114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:42.053359 12114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:42.067142 12123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:42.067171 12129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:42.067222 12126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:42.068596 12114 server_base.cc:1034] running on GCE node
I20260812 11:10:42.069355 12114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:42.070395 12114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:42.071628 12114 hybrid_clock.cc:648] HybridClock initialized: now 1786533042071559 us; error 67 us; skew 500 ppm
I20260812 11:10:42.071949 12114 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:10:42.074506 12114 webserver.cc:460] Webserver started at http://127.4.26.65:40153/ using document root <none> and password file <none>
I20260812 11:10:42.075250 12114 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:42.075359 12114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:42.075657 12114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:42.078872 12114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "5a579753296c4aacadc5bd91d61c6d9f"
format_stamp: "Formatted at 2026-08-12 11:10:42 on dist-test-slave-rmhg"
server_key: "02db8b007752b0ab582a8af0e51acb78"
server_key_iv: "5b8a4ac71061f0ac29d97e1c94ea5333"
server_key_version: "encryptionkey@0"
I20260812 11:10:42.079883 12114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "5a579753296c4aacadc5bd91d61c6d9f"
format_stamp: "Formatted at 2026-08-12 11:10:42 on dist-test-slave-rmhg"
server_key: "02db8b007752b0ab582a8af0e51acb78"
server_key_iv: "5b8a4ac71061f0ac29d97e1c94ea5333"
server_key_version: "encryptionkey@0"
I20260812 11:10:42.085891 12114 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260812 11:10:42.090188 12137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:42.091753 12114 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260812 11:10:42.091921 12114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "5a579753296c4aacadc5bd91d61c6d9f"
format_stamp: "Formatted at 2026-08-12 11:10:42 on dist-test-slave-rmhg"
server_key: "02db8b007752b0ab582a8af0e51acb78"
server_key_iv: "5b8a4ac71061f0ac29d97e1c94ea5333"
server_key_version: "encryptionkey@0"
I20260812 11:10:42.092145 12114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:42.098317 12114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:42.099189 12114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:42.099435 12114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:42.100397 12114 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:42.101893 12114 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:42.101984 12114 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:42.102072 12114 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:42.102128 12114 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:42.134357 12114 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:44435
I20260812 11:10:42.134418 12313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:44435 every 8 connection(s)
I20260812 11:10:42.135757 12114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:42.140683 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 12114
I20260812 11:10:42.140903 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:42.141779 4201 external_mini_cluster.cc:1428] Setting key 28f1a12a5d789a817200a0dacf30e152
I20260812 11:10:42.145035 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33449
--builtin_ntp_servers=127.4.26.84:42093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 11:10:42.145728 12317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:42.138824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:38539 (local address 127.4.26.126:33449)
0812 11:10:42.139568 (+ 744us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:42.139574 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:42.141222 (+ 1648us) server_negotiation.cc:407] Connection header received
0812 11:10:42.143282 (+ 2060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:42.143288 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:42.143356 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:42.143458 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:42.145003 (+ 1545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:42.145008 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:42.145011 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:42.145029 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:42.145076 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:42.145088 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:42.145229 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:42.145444 (+ 215us) server_negotiation.cc:299] Negotiation successful
0812 11:10:42.145496 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":455,"threads_started":1}
I20260812 11:10:42.147053 12318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:42.139479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:33449 (local address 127.4.26.65:38539)
0812 11:10:42.140717 (+ 1238us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:42.140774 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:42.142983 (+ 2209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:42.143758 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:42.143767 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:42.143876 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:42.144616 (+ 740us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:42.144620 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:42.144677 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:42.144806 (+ 129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:42.145212 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:42.145224 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:42.145233 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 11:10:42.145520 (+ 287us) client_negotiation.cc:240] Negotiation successful
0812 11:10:42.145808 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":284,"threads_started":1}
I20260812 11:10:42.148540 12314 heartbeater.cc:347] Connected to a master server at 127.4.26.126:33449
I20260812 11:10:42.148872 12314 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:42.149622 12314 heartbeater.cc:511] Master 127.4.26.126:33449 requested a full tablet report, sending...
I20260812 11:10:42.151794 12020 ts_manager.cc:194] Registered new tserver with Master: 5a579753296c4aacadc5bd91d61c6d9f (127.4.26.65:44435)
W20260812 11:10:42.490547 12319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:42.490841 12319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:42.490957 12319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:42.498283 12319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:42.498399 12319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:42.498555 12319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:10:42.508153 12319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:42093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33449
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:42.509615 12319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:42.511547 12319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:42.525394 12324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:42.525436 12325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:42.525635 12327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:42.526392 12319 server_base.cc:1034] running on GCE node
I20260812 11:10:42.527072 12319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:42.528192 12319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:42.529412 12319 hybrid_clock.cc:648] HybridClock initialized: now 1786533042529342 us; error 67 us; skew 500 ppm
I20260812 11:10:42.529804 12319 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:10:42.532290 12319 webserver.cc:460] Webserver started at http://127.4.26.66:35821/ using document root <none> and password file <none>
I20260812 11:10:42.533027 12319 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:42.533128 12319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:42.533483 12319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:42.536458 12319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "f8ff1c64d9634cf5a70cf0e0e4ec51fe"
format_stamp: "Formatted at 2026-08-12 11:10:42 on dist-test-slave-rmhg"
server_key: "44f6634781174a8fcb8a20b9e5a93b01"
server_key_iv: "2aab1c2630fba68352ec180afab7b50d"
server_key_version: "encryptionkey@0"
I20260812 11:10:42.537334 12319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "f8ff1c64d9634cf5a70cf0e0e4ec51fe"
format_stamp: "Formatted at 2026-08-12 11:10:42 on dist-test-slave-rmhg"
server_key: "44f6634781174a8fcb8a20b9e5a93b01"
server_key_iv: "2aab1c2630fba68352ec180afab7b50d"
server_key_version: "encryptionkey@0"
I20260812 11:10:42.542977 12319 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 11:10:42.546941 12335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:42.548537 12319 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:10:42.548715 12319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "f8ff1c64d9634cf5a70cf0e0e4ec51fe"
format_stamp: "Formatted at 2026-08-12 11:10:42 on dist-test-slave-rmhg"
server_key: "44f6634781174a8fcb8a20b9e5a93b01"
server_key_iv: "2aab1c2630fba68352ec180afab7b50d"
server_key_version: "encryptionkey@0"
I20260812 11:10:42.548956 12319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:42.554920 12319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:42.555766 12319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:42.556025 12319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:42.556959 12319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:42.558470 12319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:42.558560 12319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:42.558681 12319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:42.558753 12319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:42.591879 12319 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:37109
I20260812 11:10:42.591924 12529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:37109 every 8 connection(s)
I20260812 11:10:42.593289 12319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:42.599511 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 12319
I20260812 11:10:42.599707 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:42.600303 4201 external_mini_cluster.cc:1428] Setting key 6edc496dab3d60a5e1a00a93cf83112b
I20260812 11:10:42.602741 12317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:42.596161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:57349 (local address 127.4.26.126:33449)
0812 11:10:42.596383 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:42.596391 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:42.598031 (+ 1640us) server_negotiation.cc:407] Connection header received
0812 11:10:42.600075 (+ 2044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:42.600080 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:42.600161 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:42.600260 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:42.601911 (+ 1651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:42.601917 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:42.601923 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:42.601945 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:42.602038 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:42.602056 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:42.602191 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:42.602374 (+ 183us) server_negotiation.cc:299] Negotiation successful
0812 11:10:42.602445 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:10:42.603837 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33449
--builtin_ntp_servers=127.4.26.84:42093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260812 11:10:42.604135 12535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:42.596737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:33449 (local address 127.4.26.66:57349)
0812 11:10:42.597844 (+ 1107us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:42.597898 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:42.599674 (+ 1776us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:42.600574 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:42.600586 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:42.600730 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:42.601562 (+ 832us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:42.601566 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:42.601612 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:42.601725 (+ 113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:42.602156 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:42.602162 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:42.602168 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:10:42.602469 (+ 301us) client_negotiation.cc:240] Negotiation successful
0812 11:10:42.602776 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":394,"threads_started":1}
I20260812 11:10:42.606303 12532 heartbeater.cc:347] Connected to a master server at 127.4.26.126:33449
I20260812 11:10:42.606638 12532 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:42.607337 12532 heartbeater.cc:511] Master 127.4.26.126:33449 requested a full tablet report, sending...
I20260812 11:10:42.608798 12020 ts_manager.cc:194] Registered new tserver with Master: f8ff1c64d9634cf5a70cf0e0e4ec51fe (127.4.26.66:37109)
W20260812 11:10:42.954470 12536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:42.954778 12536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:42.954909 12536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:42.962396 12536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:42.962544 12536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:42.962688 12536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:10:42.972235 12536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:42093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33449
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:42.973686 12536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:42.975536 12536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:42.989068 12544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:42.989197 12547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:42.988993 12545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:42.990231 12536 server_base.cc:1034] running on GCE node
I20260812 11:10:42.990921 12536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:42.992031 12536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:42.993261 12536 hybrid_clock.cc:648] HybridClock initialized: now 1786533042993213 us; error 45 us; skew 500 ppm
I20260812 11:10:42.993605 12536 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:10:42.996248 12536 webserver.cc:460] Webserver started at http://127.4.26.67:45253/ using document root <none> and password file <none>
I20260812 11:10:42.996999 12536 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:42.997115 12536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:42.997478 12536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:43.000586 12536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "8618f854f7e2434aafcf15eabcd67236"
format_stamp: "Formatted at 2026-08-12 11:10:42 on dist-test-slave-rmhg"
server_key: "697527e925587f2efb4f16388599eb50"
server_key_iv: "0eb7f264636ffec5573aa9eef109b3f3"
server_key_version: "encryptionkey@0"
I20260812 11:10:43.001507 12536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "8618f854f7e2434aafcf15eabcd67236"
format_stamp: "Formatted at 2026-08-12 11:10:42 on dist-test-slave-rmhg"
server_key: "697527e925587f2efb4f16388599eb50"
server_key_iv: "0eb7f264636ffec5573aa9eef109b3f3"
server_key_version: "encryptionkey@0"
I20260812 11:10:43.007355 12536 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:10:43.011341 12556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:43.012800 12536 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:10:43.012982 12536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "8618f854f7e2434aafcf15eabcd67236"
format_stamp: "Formatted at 2026-08-12 11:10:42 on dist-test-slave-rmhg"
server_key: "697527e925587f2efb4f16388599eb50"
server_key_iv: "0eb7f264636ffec5573aa9eef109b3f3"
server_key_version: "encryptionkey@0"
I20260812 11:10:43.013314 12536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:43.019513 12536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:43.020476 12536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:43.020768 12536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:43.021840 12536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:43.023413 12536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:43.023516 12536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:43.023635 12536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:43.023708 12536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:43.055956 12536 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:34187
I20260812 11:10:43.056010 12745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:34187 every 8 connection(s)
I20260812 11:10:43.057428 12536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:43.065658 12317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.060083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:48039 (local address 127.4.26.126:33449)
0812 11:10:43.060311 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:43.060318 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:43.061862 (+ 1544us) server_negotiation.cc:407] Connection header received
0812 11:10:43.063529 (+ 1667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:43.063534 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:43.063597 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:43.063687 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:43.064927 (+ 1240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:43.064932 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:43.064936 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:43.064952 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:43.064984 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:43.064995 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:43.065089 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:43.065375 (+ 286us) server_negotiation.cc:299] Negotiation successful
0812 11:10:43.065429 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 11:10:43.066658 12748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.060631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:33449 (local address 127.4.26.67:48039)
0812 11:10:43.061712 (+ 1081us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:43.061749 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:43.063279 (+ 1530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:43.063885 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:43.063892 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:43.063983 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:43.064629 (+ 646us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:43.064632 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:43.064672 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:43.064762 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:43.065115 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:43.065124 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:43.065131 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 11:10:43.065437 (+ 306us) client_negotiation.cc:240] Negotiation successful
0812 11:10:43.065662 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":303,"threads_started":1}
I20260812 11:10:43.067376 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 12536
I20260812 11:10:43.067584 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:43.068166 4201 external_mini_cluster.cc:1428] Setting key 435f0dc30f725504d1653c12afb3c17a
I20260812 11:10:43.068252 12746 heartbeater.cc:347] Connected to a master server at 127.4.26.126:33449
I20260812 11:10:43.068557 12746 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:43.069322 12746 heartbeater.cc:511] Master 127.4.26.126:33449 requested a full tablet report, sending...
I20260812 11:10:43.071103 12019 ts_manager.cc:194] Registered new tserver with Master: 8618f854f7e2434aafcf15eabcd67236 (127.4.26.67:34187)
I20260812 11:10:43.084416 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:10:43.091867 12317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.089205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48356 (local address 127.4.26.126:33449)
0812 11:10:43.089433 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:43.089440 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:43.089797 (+ 357us) server_negotiation.cc:407] Connection header received
0812 11:10:43.089932 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:43.089936 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:43.090016 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:43.090109 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:43.091131 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:43.091136 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:43.091139 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:43.091157 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:43.091194 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:43.091207 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:43.091317 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:43.091512 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 11:10:43.091584 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:10:43.096894 12019 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48356:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:10:43.104106 12019 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:10:43.127076 12763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.117191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:37109 (local address 127.0.0.1:40894)
0812 11:10:43.118056 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:43.118126 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:43.118278 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:43.121653 (+ 3375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:43.121662 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:43.121786 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:43.123574 (+ 1788us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:43.123579 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:43.123616 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:43.123742 (+ 126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:43.126085 (+ 2343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:43.126106 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:43.126117 (+ 11us) client_negotiation.cc:769] Sending connection context
0812 11:10:43.126367 (+ 250us) client_negotiation.cc:240] Negotiation successful
0812 11:10:43.126516 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":331,"threads_started":1}
I20260812 11:10:43.128263 12765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.117250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40894 (local address 127.4.26.66:37109)
0812 11:10:43.119584 (+ 2334us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:43.119595 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:43.119631 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:10:43.119712 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:43.119723 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:43.120003 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:43.120185 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:43.123982 (+ 3797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:43.123994 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:43.124016 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:43.125649 (+ 1633us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:43.125768 (+ 119us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:43.125813 (+ 45us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:43.126005 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:43.127735 (+ 1730us) server_negotiation.cc:299] Negotiation successful
0812 11:10:43.127890 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2155,"thread_start_us":2032,"threads_started":1}
I20260812 11:10:43.133317 12763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.118968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:34187 (local address 127.0.0.1:53330)
0812 11:10:43.127398 (+ 8430us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:43.127418 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:43.127524 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:43.131286 (+ 3762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:43.131291 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:43.131357 (+ 66us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:43.132058 (+ 701us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:43.132062 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:43.132084 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:43.132143 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:43.132558 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:43.132563 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:43.132567 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:10:43.132666 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 11:10:43.132729 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8312,"threads_started":1}
I20260812 11:10:43.133390 12770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.119184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53330 (local address 127.4.26.67:34187)
0812 11:10:43.130774 (+ 11590us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:43.130781 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:43.130813 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:10:43.130877 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:43.130883 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:43.131089 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:43.131260 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:43.132352 (+ 1092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:43.132360 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:43.132371 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:43.132385 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:43.132426 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:43.132440 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:43.132630 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:43.132699 (+ 69us) server_negotiation.cc:299] Negotiation successful
0812 11:10:43.132804 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11431,"thread_start_us":11222,"threads_started":1}
I20260812 11:10:43.134112 12424 tablet_service.cc:1467] Processing CreateTablet for tablet 0a803b436e9947afb500355561ad0e5c (DEFAULT_TABLE table=test-table [id=803ccc959a7241a6a50b043cff92820f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:43.136291 12424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a803b436e9947afb500355561ad0e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:43.146551 12767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.118665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52724 (local address 127.4.26.65:44435)
0812 11:10:43.143955 (+ 25290us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:43.143975 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:43.144016 (+ 41us) server_negotiation.cc:407] Connection header received
0812 11:10:43.144092 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:43.144099 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:43.144308 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:43.144491 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:43.145681 (+ 1190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:43.145690 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:43.145705 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:43.145731 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:43.145787 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:43.145807 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:43.145992 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:43.146064 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 11:10:43.146176 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25089,"spinlock_wait_cycles":28416,"thread_start_us":25066,"threads_started":1}
I20260812 11:10:43.146579 12766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.118356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:44435 (local address 127.0.0.1:52724)
0812 11:10:43.118953 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:43.118977 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:43.119098 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:43.144520 (+ 25422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:43.144526 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:43.144557 (+ 31us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:43.145378 (+ 821us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:43.145382 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:43.145403 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:43.145463 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:43.145919 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:43.145924 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:43.145928 (+ 4us) client_negotiation.cc:769] Sending connection context
0812 11:10:43.146072 (+ 144us) client_negotiation.cc:240] Negotiation successful
0812 11:10:43.146140 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":273,"threads_started":1}
I20260812 11:10:43.148346 12639 tablet_service.cc:1467] Processing CreateTablet for tablet 0a803b436e9947afb500355561ad0e5c (DEFAULT_TABLE table=test-table [id=803ccc959a7241a6a50b043cff92820f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:43.150270 12639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a803b436e9947afb500355561ad0e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:43.151283 12213 tablet_service.cc:1467] Processing CreateTablet for tablet 0a803b436e9947afb500355561ad0e5c (DEFAULT_TABLE table=test-table [id=803ccc959a7241a6a50b043cff92820f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:10:43.152765 12771 tablet_bootstrap.cc:492] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe: Bootstrap starting.
I20260812 11:10:43.152846 12213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a803b436e9947afb500355561ad0e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:43.155073 12314 heartbeater.cc:503] Master 127.4.26.126:33449 was elected leader, sending a full tablet report...
I20260812 11:10:43.156581 12771 tablet_bootstrap.cc:654] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:43.158080 12771 log.cc:824] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:43.161358 12771 tablet_bootstrap.cc:492] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe: No bootstrap required, opened a new log
I20260812 11:10:43.161659 12771 ts_tablet_manager.cc:1397] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260812 11:10:43.166069 12773 tablet_bootstrap.cc:492] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236: Bootstrap starting.
I20260812 11:10:43.168433 12775 tablet_bootstrap.cc:492] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f: Bootstrap starting.
I20260812 11:10:43.170444 12771 raft_consensus.cc:348] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8ff1c64d9634cf5a70cf0e0e4ec51fe" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37109 } } peers { permanent_uuid: "5a579753296c4aacadc5bd91d61c6d9f" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 44435 } } peers { permanent_uuid: "8618f854f7e2434aafcf15eabcd67236" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34187 } }
I20260812 11:10:43.170861 12771 raft_consensus.cc:374] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:43.170980 12771 raft_consensus.cc:729] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8ff1c64d9634cf5a70cf0e0e4ec51fe, State: Initialized, Role: FOLLOWER
I20260812 11:10:43.171296 12773 tablet_bootstrap.cc:654] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:43.171631 12771 consensus_queue.cc:260] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8ff1c64d9634cf5a70cf0e0e4ec51fe" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37109 } } peers { permanent_uuid: "5a579753296c4aacadc5bd91d61c6d9f" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 44435 } } peers { permanent_uuid: "8618f854f7e2434aafcf15eabcd67236" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34187 } }
I20260812 11:10:43.172369 12775 tablet_bootstrap.cc:654] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:43.172789 12532 heartbeater.cc:503] Master 127.4.26.126:33449 was elected leader, sending a full tablet report...
I20260812 11:10:43.172799 12773 log.cc:824] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:43.173501 12771 ts_tablet_manager.cc:1428] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260812 11:10:43.173763 12775 log.cc:824] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:43.176642 12775 tablet_bootstrap.cc:492] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f: No bootstrap required, opened a new log
I20260812 11:10:43.176797 12773 tablet_bootstrap.cc:492] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236: No bootstrap required, opened a new log
I20260812 11:10:43.176967 12775 ts_tablet_manager.cc:1397] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 11:10:43.177105 12773 ts_tablet_manager.cc:1397] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260812 11:10:43.185727 12773 raft_consensus.cc:348] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8ff1c64d9634cf5a70cf0e0e4ec51fe" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37109 } } peers { permanent_uuid: "5a579753296c4aacadc5bd91d61c6d9f" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 44435 } } peers { permanent_uuid: "8618f854f7e2434aafcf15eabcd67236" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34187 } }
I20260812 11:10:43.185704 12775 raft_consensus.cc:348] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8ff1c64d9634cf5a70cf0e0e4ec51fe" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37109 } } peers { permanent_uuid: "5a579753296c4aacadc5bd91d61c6d9f" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 44435 } } peers { permanent_uuid: "8618f854f7e2434aafcf15eabcd67236" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34187 } }
I20260812 11:10:43.186132 12773 raft_consensus.cc:374] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:43.186136 12775 raft_consensus.cc:374] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:43.186236 12775 raft_consensus.cc:729] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a579753296c4aacadc5bd91d61c6d9f, State: Initialized, Role: FOLLOWER
I20260812 11:10:43.186286 12773 raft_consensus.cc:729] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8618f854f7e2434aafcf15eabcd67236, State: Initialized, Role: FOLLOWER
I20260812 11:10:43.186899 12775 consensus_queue.cc:260] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8ff1c64d9634cf5a70cf0e0e4ec51fe" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37109 } } peers { permanent_uuid: "5a579753296c4aacadc5bd91d61c6d9f" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 44435 } } peers { permanent_uuid: "8618f854f7e2434aafcf15eabcd67236" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34187 } }
I20260812 11:10:43.186925 12773 consensus_queue.cc:260] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8ff1c64d9634cf5a70cf0e0e4ec51fe" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37109 } } peers { permanent_uuid: "5a579753296c4aacadc5bd91d61c6d9f" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 44435 } } peers { permanent_uuid: "8618f854f7e2434aafcf15eabcd67236" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34187 } }
I20260812 11:10:43.188637 12746 heartbeater.cc:503] Master 127.4.26.126:33449 was elected leader, sending a full tablet report...
I20260812 11:10:43.188988 12775 ts_tablet_manager.cc:1428] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260812 11:10:43.189319 12773 ts_tablet_manager.cc:1428] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260812 11:10:43.291617 12785 raft_consensus.cc:482] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:43.291942 12785 raft_consensus.cc:504] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8ff1c64d9634cf5a70cf0e0e4ec51fe" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37109 } } peers { permanent_uuid: "5a579753296c4aacadc5bd91d61c6d9f" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 44435 } } peers { permanent_uuid: "8618f854f7e2434aafcf15eabcd67236" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34187 } }
I20260812 11:10:43.293805 12785 leader_election.cc:288] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8ff1c64d9634cf5a70cf0e0e4ec51fe (127.4.26.66:37109), 8618f854f7e2434aafcf15eabcd67236 (127.4.26.67:34187)
I20260812 11:10:43.297740 12770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.294407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:57773 (local address 127.4.26.67:34187)
0812 11:10:43.294578 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:43.294583 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:43.295321 (+ 738us) server_negotiation.cc:407] Connection header received
0812 11:10:43.295497 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:43.295503 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:43.295572 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:43.295725 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:43.297016 (+ 1291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:43.297023 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:43.297028 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:43.297050 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:43.297093 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:43.297109 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:43.297282 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:43.297384 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 11:10:43.297453 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:10:43.297856 12765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.294347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:40971 (local address 127.4.26.66:37109)
0812 11:10:43.294564 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:43.294570 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:43.295321 (+ 751us) server_negotiation.cc:407] Connection header received
0812 11:10:43.295497 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:43.295503 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:43.295572 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:43.295692 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:43.297016 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:43.297023 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:43.297028 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:43.297050 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:43.297093 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:43.297109 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:43.297278 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:43.297520 (+ 242us) server_negotiation.cc:299] Negotiation successful
0812 11:10:43.297589 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 11:10:43.298092 12787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.294144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:34187 (local address 127.4.26.65:57773)
0812 11:10:43.295155 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:43.295181 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:43.295358 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:43.295783 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:43.295789 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:43.295818 (+ 29us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:43.296775 (+ 957us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:43.296778 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:43.296789 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:43.296832 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:43.297242 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:43.297248 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:43.297254 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:10:43.297395 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 11:10:43.297452 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":856,"spinlock_wait_cycles":47232,"thread_start_us":608,"threads_started":1}
I20260812 11:10:43.298161 12788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.294227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:37109 (local address 127.4.26.65:40971)
0812 11:10:43.295191 (+ 964us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:43.295212 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:43.295358 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:43.295783 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:43.295789 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:43.295818 (+ 29us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:43.296747 (+ 929us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:10:43.296751 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:43.296773 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:10:43.296832 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:43.297356 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:43.297361 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:43.297367 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:10:43.297536 (+ 169us) client_negotiation.cc:240] Negotiation successful
0812 11:10:43.297593 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":866,"spinlock_wait_cycles":1408,"thread_start_us":554,"threads_started":1}
I20260812 11:10:43.299175 12455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a803b436e9947afb500355561ad0e5c" candidate_uuid: "5a579753296c4aacadc5bd91d61c6d9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8ff1c64d9634cf5a70cf0e0e4ec51fe" is_pre_election: true
I20260812 11:10:43.299182 12671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a803b436e9947afb500355561ad0e5c" candidate_uuid: "5a579753296c4aacadc5bd91d61c6d9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8618f854f7e2434aafcf15eabcd67236" is_pre_election: true
I20260812 11:10:43.299686 12455 raft_consensus.cc:2454] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a579753296c4aacadc5bd91d61c6d9f in term 0.
I20260812 11:10:43.299683 12671 raft_consensus.cc:2454] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a579753296c4aacadc5bd91d61c6d9f in term 0.
I20260812 11:10:43.300360 12139 leader_election.cc:302] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a579753296c4aacadc5bd91d61c6d9f, f8ff1c64d9634cf5a70cf0e0e4ec51fe; no voters:
I20260812 11:10:43.300809 12785 raft_consensus.cc:2781] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:10:43.300961 12785 raft_consensus.cc:482] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:10:43.301072 12785 raft_consensus.cc:3037] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:43.303447 12785 raft_consensus.cc:504] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8ff1c64d9634cf5a70cf0e0e4ec51fe" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37109 } } peers { permanent_uuid: "5a579753296c4aacadc5bd91d61c6d9f" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 44435 } } peers { permanent_uuid: "8618f854f7e2434aafcf15eabcd67236" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34187 } }
I20260812 11:10:43.304150 12785 leader_election.cc:288] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [CANDIDATE]: Term 1 election: Requested vote from peers f8ff1c64d9634cf5a70cf0e0e4ec51fe (127.4.26.66:37109), 8618f854f7e2434aafcf15eabcd67236 (127.4.26.67:34187)
I20260812 11:10:43.304811 12455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a803b436e9947afb500355561ad0e5c" candidate_uuid: "5a579753296c4aacadc5bd91d61c6d9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8ff1c64d9634cf5a70cf0e0e4ec51fe"
I20260812 11:10:43.304822 12671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a803b436e9947afb500355561ad0e5c" candidate_uuid: "5a579753296c4aacadc5bd91d61c6d9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8618f854f7e2434aafcf15eabcd67236"
I20260812 11:10:43.305016 12455 raft_consensus.cc:3037] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:43.305073 12671 raft_consensus.cc:3037] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:43.307561 12455 raft_consensus.cc:2454] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a579753296c4aacadc5bd91d61c6d9f in term 1.
I20260812 11:10:43.307580 12671 raft_consensus.cc:2454] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a579753296c4aacadc5bd91d61c6d9f in term 1.
I20260812 11:10:43.308116 12139 leader_election.cc:302] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5a579753296c4aacadc5bd91d61c6d9f, 8618f854f7e2434aafcf15eabcd67236, f8ff1c64d9634cf5a70cf0e0e4ec51fe; no voters:
I20260812 11:10:43.308531 12785 raft_consensus.cc:2781] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [term 1 FOLLOWER]: Leader election won for term 1
W20260812 11:10:43.309099 12747 tablet.cc:2369] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:43.309089 12785 raft_consensus.cc:686] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [term 1 LEADER]: Becoming Leader. State: Replica: 5a579753296c4aacadc5bd91d61c6d9f, State: Running, Role: LEADER
I20260812 11:10:43.309779 12785 consensus_queue.cc:237] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8ff1c64d9634cf5a70cf0e0e4ec51fe" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37109 } } peers { permanent_uuid: "5a579753296c4aacadc5bd91d61c6d9f" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 44435 } } peers { permanent_uuid: "8618f854f7e2434aafcf15eabcd67236" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34187 } }
I20260812 11:10:43.315552 12019 catalog_manager.cc:5495] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a579753296c4aacadc5bd91d61c6d9f (127.4.26.65). New cstate: current_term: 1 leader_uuid: "5a579753296c4aacadc5bd91d61c6d9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8ff1c64d9634cf5a70cf0e0e4ec51fe" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a579753296c4aacadc5bd91d61c6d9f" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 44435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8618f854f7e2434aafcf15eabcd67236" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34187 } health_report { overall_health: UNKNOWN } } }
W20260812 11:10:43.345448 12534 tablet.cc:2369] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:43.367900 12767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.365815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52736 (local address 127.4.26.65:44435)
0812 11:10:43.366006 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:43.366012 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:43.366032 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:10:43.366238 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:43.366243 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:43.366328 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:43.366416 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:43.367305 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:43.367310 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:43.367313 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:43.367327 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:43.367361 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:43.367373 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:43.367484 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:43.367593 (+ 109us) server_negotiation.cc:299] Negotiation successful
0812 11:10:43.367653 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:10:43.377633 12671 raft_consensus.cc:1261] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236 [term 1 FOLLOWER]: Refusing update from remote peer 5a579753296c4aacadc5bd91d61c6d9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:43.377630 12455 raft_consensus.cc:1261] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe [term 1 FOLLOWER]: Refusing update from remote peer 5a579753296c4aacadc5bd91d61c6d9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:10:43.378652 12789 consensus_queue.cc:1035] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8618f854f7e2434aafcf15eabcd67236" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 34187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:43.379046 12785 consensus_queue.cc:1035] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8ff1c64d9634cf5a70cf0e0e4ec51fe" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:10:43.389222 12316 tablet.cc:2369] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:10:43.393440 12800 mvcc.cc:205] Tried to move back new op lower bound from 7317639345662918656 to 7317639345401409536. Current Snapshot: MvccSnapshot[applied={T|T < 7317639345662918656}]
I20260812 11:10:43.416334 12020 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:43.416674 12020 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:10:43.421298 12020 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5882cd228454422ab69fc3a78dead0b4: Sending DeleteTablet for 3 replicas of tablet 0a803b436e9947afb500355561ad0e5c
I20260812 11:10:43.422848 12639 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a803b436e9947afb500355561ad0e5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:43 UTC) from {username='slave'} at 127.0.0.1:53330
I20260812 11:10:43.423208 12213 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a803b436e9947afb500355561ad0e5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:43 UTC) from {username='slave'} at 127.0.0.1:52724
I20260812 11:10:43.423411 12424 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a803b436e9947afb500355561ad0e5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:10:43 UTC) from {username='slave'} at 127.0.0.1:40894
I20260812 11:10:43.425071 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 12114
I20260812 11:10:43.454735 12823 tablet_replica.cc:330] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f: stopping tablet replica
I20260812 11:10:43.456089 12767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.427167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52746 (local address 127.4.26.65:44435)
0812 11:10:43.427867 (+ 700us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:43.427875 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:43.451321 (+ 23446us) server_negotiation.cc:407] Connection header received
0812 11:10:43.452058 (+ 737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:43.452066 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:43.452158 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:43.452243 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:43.455063 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:43.455073 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:43.455078 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:43.455109 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:43.455165 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:43.455184 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:43.455318 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:43.455645 (+ 327us) server_negotiation.cc:299] Negotiation successful
0812 11:10:43.455734 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512}
I20260812 11:10:43.457649 12308 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:43.458606 12820 tablet_replica.cc:330] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236: stopping tablet replica
I20260812 11:10:43.459100 12820 raft_consensus.cc:2229] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:43.459734 12820 raft_consensus.cc:2258] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:43.460681 12824 tablet_replica.cc:330] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe: stopping tablet replica
I20260812 11:10:43.461265 12824 raft_consensus.cc:2229] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:43.462050 12824 raft_consensus.cc:2258] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:43.462658 12820 ts_tablet_manager.cc:1905] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:43.464290 12824 ts_tablet_manager.cc:1905] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:43.469877 12820 ts_tablet_manager.cc:1918] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:43.470135 12820 log.cc:1196] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/0a803b436e9947afb500355561ad0e5c
I20260812 11:10:43.470683 12820 ts_tablet_manager.cc:1939] T 0a803b436e9947afb500355561ad0e5c P 8618f854f7e2434aafcf15eabcd67236: Deleting consensus metadata
I20260812 11:10:43.471313 12824 ts_tablet_manager.cc:1918] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:43.471503 12824 log.cc:1196] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/0a803b436e9947afb500355561ad0e5c
I20260812 11:10:43.472047 12824 ts_tablet_manager.cc:1939] T 0a803b436e9947afb500355561ad0e5c P f8ff1c64d9634cf5a70cf0e0e4ec51fe: Deleting consensus metadata
I20260812 11:10:43.472939 11989 catalog_manager.cc:4841] TS 8618f854f7e2434aafcf15eabcd67236 (127.4.26.67:34187): tablet 0a803b436e9947afb500355561ad0e5c (table test-table [id=803ccc959a7241a6a50b043cff92820f]) successfully deleted
I20260812 11:10:43.473948 11986 catalog_manager.cc:4841] TS f8ff1c64d9634cf5a70cf0e0e4ec51fe (127.4.26.66:37109): tablet 0a803b436e9947afb500355561ad0e5c (table test-table [id=803ccc959a7241a6a50b043cff92820f]) successfully deleted
I20260812 11:10:43.457916 12823 raft_consensus.cc:2229] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:10:43.557492 12823 raft_consensus.cc:2258] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:43.559513 12823 ts_tablet_manager.cc:1905] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:43.566186 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 12114
I20260812 11:10:43.566188 12823 ts_tablet_manager.cc:1918] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:10:43.566412 12823 log.cc:1196] T 0a803b436e9947afb500355561ad0e5c P 5a579753296c4aacadc5bd91d61c6d9f: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/0a803b436e9947afb500355561ad0e5c
W20260812 11:10:43.592418 11986 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.26.65:44435 (error 108)
I20260812 11:10:43.593351 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 12319
I20260812 11:10:43.594637 12766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.594021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:44435 (local address 127.0.0.1:52752)
0812 11:10:43.594318 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:43.594465 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:44435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181}
W20260812 11:10:43.594908 11986 catalog_manager.cc:4584] TS 5a579753296c4aacadc5bd91d61c6d9f (127.4.26.65:44435): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0a803b436e9947afb500355561ad0e5c: Network error: Client connection negotiation failed: client connection to 127.4.26.65:44435: connect: Connection refused (error 111)
I20260812 11:10:43.596443 12765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.594235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40900 (local address 127.4.26.66:37109)
0812 11:10:43.594438 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:43.594444 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:43.594464 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:10:43.594582 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:43.594588 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:43.594707 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:43.594802 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:43.595837 (+ 1035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:43.595843 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:43.595848 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:43.595868 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:43.595906 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:43.595921 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:43.596040 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:43.596085 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 11:10:43.596143 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 11:10:43.597241 12524 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:43.648958 12766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.648375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:44435 (local address 127.0.0.1:52754)
0812 11:10:43.648652 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:43.648778 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:44435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260812 11:10:43.650259 12766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.649859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:44435 (local address 127.0.0.1:52762)
0812 11:10:43.650041 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:43.650121 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:44435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260812 11:10:43.687439 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 12319
I20260812 11:10:43.710748 12766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.710258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:44435 (local address 127.0.0.1:52774)
0812 11:10:43.710461 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:43.710554 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:44435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 11:10:43.711829 12766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.711458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:44435 (local address 127.0.0.1:52784)
0812 11:10:43.711615 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:43.711693 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:44435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 11:10:43.715425 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 12536
I20260812 11:10:43.718324 12770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.716274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53338 (local address 127.4.26.67:34187)
0812 11:10:43.716460 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:43.716464 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:43.716485 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:10:43.716649 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:43.716654 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:43.716757 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:43.716843 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:43.717761 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:43.717766 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:43.717769 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:43.717786 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:43.717819 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:43.717831 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:43.717943 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:43.717978 (+ 35us) server_negotiation.cc:299] Negotiation successful
0812 11:10:43.718026 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:10:43.719015 12741 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:43.792889 12766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.792265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:44435 (local address 127.0.0.1:52798)
0812 11:10:43.792579 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:43.792709 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:44435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260812 11:10:43.794291 12766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:43.793788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:44435 (local address 127.0.0.1:52812)
0812 11:10:43.794061 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:43.794151 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:44435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
I20260812 11:10:43.808255 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 12536
I20260812 11:10:43.829272 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 11961
I20260812 11:10:43.830673 12071 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:43.938118 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 11961
2026-08-12T11:10:43Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2904 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260812 11:10:43.987320 4201 mini_oidc.cc:152] Starting JWKS server
I20260812 11:10:43.990764 4201 webserver.cc:460] Webserver started at https://127.0.0.1:39619/ using document root <none> and password file <none>
I20260812 11:10:43.991204 4201 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 11:10:43.991964 4201 webserver.cc:460] Webserver started at http://127.0.0.1:33043/ using document root <none> and password file <none>
2026-08-12T11:10:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:44Z Disabled control of system clock
I20260812 11:10:44.026402 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:34687
--webserver_interface=127.4.26.126
--webserver_port=0
--builtin_ntp_servers=127.4.26.84:36577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:34687
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39619/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/testchainca.cert with env {}
W20260812 11:10:44.381350 12848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:44.381827 12848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:44.381982 12848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:44.391422 12848 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:44.391579 12848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:44.391647 12848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:44.391727 12848 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:44.391793 12848 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 11:10:44.391880 12848 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 11:10:44.391933 12848 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39619/jwks.json
I20260812 11:10:44.403079 12848 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:36577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:34687
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:34687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39619/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:44.404587 12848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:44.406142 12848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:44.419191 12859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:44.419103 12866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:44.419158 12861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:44.420074 12848 server_base.cc:1034] running on GCE node
I20260812 11:10:44.420991 12848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:44.422600 12848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:44.423836 12848 hybrid_clock.cc:648] HybridClock initialized: now 1786533044423790 us; error 35 us; skew 500 ppm
I20260812 11:10:44.424229 12848 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:10:44.426857 12848 webserver.cc:460] Webserver started at http://127.4.26.126:42633/ using document root <none> and password file <none>
I20260812 11:10:44.427598 12848 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:44.427718 12848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:44.428028 12848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:44.431200 12848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "0bb8a58133a2440bb895e5641104b299"
format_stamp: "Formatted at 2026-08-12 11:10:44 on dist-test-slave-rmhg"
server_key: "18dba82eae80bd53b7797ae1a618685c"
server_key_iv: "c86b2152c7663acf84fd62eb9ecdf147"
server_key_version: "encryptionkey@0"
I20260812 11:10:44.432076 12848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "0bb8a58133a2440bb895e5641104b299"
format_stamp: "Formatted at 2026-08-12 11:10:44 on dist-test-slave-rmhg"
server_key: "18dba82eae80bd53b7797ae1a618685c"
server_key_iv: "c86b2152c7663acf84fd62eb9ecdf147"
server_key_version: "encryptionkey@0"
I20260812 11:10:44.438124 12848 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260812 11:10:44.442814 12873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:44.444867 12848 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:10:44.445104 12848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "0bb8a58133a2440bb895e5641104b299"
format_stamp: "Formatted at 2026-08-12 11:10:44 on dist-test-slave-rmhg"
server_key: "18dba82eae80bd53b7797ae1a618685c"
server_key_iv: "c86b2152c7663acf84fd62eb9ecdf147"
server_key_version: "encryptionkey@0"
I20260812 11:10:44.445399 12848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:44.459657 12848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:44.460588 12848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:44.460878 12848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:44.479357 12848 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:34687
I20260812 11:10:44.479378 12961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:34687 every 8 connection(s)
I20260812 11:10:44.480857 12848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:44.485203 12962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:44.490623 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 12848
I20260812 11:10:44.490890 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:10:44.491719 4201 external_mini_cluster.cc:1428] Setting key 32f1820484aa97799d5350cb8c324276
I20260812 11:10:44.498204 12962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299: Bootstrap starting.
I20260812 11:10:44.502185 12962 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:44.503443 12962 log.cc:824] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:44.507360 12966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:44.494085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55404 (local address 127.4.26.126:34687)
0812 11:10:44.495209 (+ 1124us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:44.495223 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:44.495277 (+ 54us) server_negotiation.cc:407] Connection header received
0812 11:10:44.497123 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:44.497195 (+ 72us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:44.497766 (+ 571us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:44.498197 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:44.498898 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:44.500367 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:44.501963 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:44.502804 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:44.503005 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:44.504342 (+ 1337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:44.504351 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:44.504369 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:44.505045 (+ 676us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:44.505193 (+ 148us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:44.505225 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:44.505364 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:44.505578 (+ 214us) server_negotiation.cc:299] Negotiation successful
0812 11:10:44.505960 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":327,"threads_started":1}
I20260812 11:10:44.507416 12962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299: No bootstrap required, opened a new log
I20260812 11:10:44.512164 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:44.517702 12962 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bb8a58133a2440bb895e5641104b299" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34687 } }
I20260812 11:10:44.518108 12962 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:44.518196 12962 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bb8a58133a2440bb895e5641104b299, State: Initialized, Role: FOLLOWER
I20260812 11:10:44.518738 12962 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bb8a58133a2440bb895e5641104b299" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34687 } }
I20260812 11:10:44.518949 12962 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:44.519049 12962 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:44.519186 12962 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:44.521639 12962 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bb8a58133a2440bb895e5641104b299" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34687 } }
I20260812 11:10:44.522182 12962 leader_election.cc:302] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0bb8a58133a2440bb895e5641104b299; no voters:
I20260812 11:10:44.522761 12962 leader_election.cc:288] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:44.522910 12970 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:44.524012 12970 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [term 1 LEADER]: Becoming Leader. State: Replica: 0bb8a58133a2440bb895e5641104b299, State: Running, Role: LEADER
I20260812 11:10:44.524618 12970 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bb8a58133a2440bb895e5641104b299" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34687 } }
I20260812 11:10:44.525014 12962 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:44.527712 12972 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0bb8a58133a2440bb895e5641104b299. Latest consensus state: current_term: 1 leader_uuid: "0bb8a58133a2440bb895e5641104b299" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bb8a58133a2440bb895e5641104b299" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34687 } } }
I20260812 11:10:44.528323 12972 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:44.527724 12971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0bb8a58133a2440bb895e5641104b299" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bb8a58133a2440bb895e5641104b299" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34687 } } }
I20260812 11:10:44.528476 12971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:44.529258 12983 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:44.534816 12983 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:44.545120 12983 catalog_manager.cc:1347] Generated new cluster ID: ed709cd40a0c4652ae0d30ed3b3ad19c
I20260812 11:10:44.545272 12983 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:44.558305 12983 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:44.559923 12983 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:44.573664 12983 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0bb8a58133a2440bb895e5641104b299: Generated new TSK 0
I20260812 11:10:44.574683 12983 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 11:10:44.619086 13008 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260812 11:10:44.619334 13008 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 11:10:44.620648 12966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:44.595764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55420 (local address 127.4.26.126:34687)
0812 11:10:44.595995 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:44.596003 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:44.596529 (+ 526us) server_negotiation.cc:407] Connection header received
0812 11:10:44.596953 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:44.596960 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:44.597068 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:44.597315 (+ 247us) server_negotiation.cc:226] Negotiated authn=JWT
0812 11:10:44.597910 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:44.599102 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:44.601232 (+ 2130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:44.601954 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:44.602149 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:44.602896 (+ 747us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 11:10:44.619893 (+ 16997us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39619/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 11:10:44.620328 (+ 435us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55420: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39619/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":75}
W20260812 11:10:44.620790 12966 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55420: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39619/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260812 11:10:44.622325 13006 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:44.595563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:34687 (local address 127.0.0.1:55420)
0812 11:10:44.596409 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:44.596426 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:44.596616 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:44.597358 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:44.597362 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:44.597375 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0812 11:10:44.597739 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:44.597749 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:44.599328 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:44.599334 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:44.600918 (+ 1584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:44.600939 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:44.602231 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:44.602238 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:44.602411 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:44.602548 (+ 137us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 11:10:44.620233 (+ 17685us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39619/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0812 11:10:44.620587 (+ 354us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.4.26.126:34687: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39619/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":468,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.4.26.126:34687: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39619/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260812 11:10:44.624114 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 12848
I20260812 11:10:44.625448 12953 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:44.722199 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 12848
2026-08-12T11:10:44Z chronyd exiting
I20260812 11:10:44.783629 4201 test_util.cc:175] -----------------------------------------------
I20260812 11:10:44.783787 4201 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786532997575371-4201-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (801 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260812 11:10:44.787878 4201 mini_oidc.cc:152] Starting JWKS server
I20260812 11:10:44.790000 4201 webserver.cc:460] Webserver started at https://127.0.0.1:35617/ using document root <none> and password file <none>
I20260812 11:10:44.790324 4201 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 11:10:44.791061 4201 webserver.cc:460] Webserver started at http://127.0.0.1:38303/ using document root <none> and password file <none>
2026-08-12T11:10:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:44Z Disabled control of system clock
I20260812 11:10:44.826591 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:41261
--webserver_interface=127.4.26.126
--webserver_port=0
--builtin_ntp_servers=127.4.26.84:43629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:41261
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35617/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/testchainca.cert with env {}
W20260812 11:10:45.197492 13020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:45.197827 13020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:45.197956 13020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:45.205576 13020 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:45.205721 13020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:45.205765 13020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:45.205845 13020 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:45.205901 13020 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 11:10:45.205964 13020 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 11:10:45.206022 13020 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35617/jwks.json
I20260812 11:10:45.217902 13020 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:43629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:41261
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:41261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35617/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:45.219678 13020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:45.221428 13020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:45.235598 13030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:45.235617 13035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:45.235656 13027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:45.236405 13020 server_base.cc:1034] running on GCE node
I20260812 11:10:45.237399 13020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:45.239045 13020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:45.240341 13020 hybrid_clock.cc:648] HybridClock initialized: now 1786533045240286 us; error 50 us; skew 500 ppm
I20260812 11:10:45.240813 13020 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:10:45.243729 13020 webserver.cc:460] Webserver started at http://127.4.26.126:41157/ using document root <none> and password file <none>
I20260812 11:10:45.244594 13020 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:45.244751 13020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:45.245124 13020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:45.248466 13020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "ab175173559a4770ad469820fb060a85"
format_stamp: "Formatted at 2026-08-12 11:10:45 on dist-test-slave-rmhg"
server_key: "df5adee4a492a635650360f68b318d61"
server_key_iv: "851737b147bc62281f5dfd047d0eb21d"
server_key_version: "encryptionkey@0"
I20260812 11:10:45.249456 13020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "ab175173559a4770ad469820fb060a85"
format_stamp: "Formatted at 2026-08-12 11:10:45 on dist-test-slave-rmhg"
server_key: "df5adee4a492a635650360f68b318d61"
server_key_iv: "851737b147bc62281f5dfd047d0eb21d"
server_key_version: "encryptionkey@0"
I20260812 11:10:45.255373 13020 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:10:45.259138 13043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:45.260622 13020 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:10:45.260861 13020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "ab175173559a4770ad469820fb060a85"
format_stamp: "Formatted at 2026-08-12 11:10:45 on dist-test-slave-rmhg"
server_key: "df5adee4a492a635650360f68b318d61"
server_key_iv: "851737b147bc62281f5dfd047d0eb21d"
server_key_version: "encryptionkey@0"
I20260812 11:10:45.261097 13020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:45.276079 13020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:45.277024 13020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:45.277370 13020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:45.296377 13020 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:41261
I20260812 11:10:45.296381 13132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:41261 every 8 connection(s)
I20260812 11:10:45.298060 13020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:45.302877 13135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:45.303416 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 13020
I20260812 11:10:45.303599 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:10:45.304349 4201 external_mini_cluster.cc:1428] Setting key f570f4ce8eb88c1f4f294adca11ba74b
I20260812 11:10:45.317003 13135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85: Bootstrap starting.
I20260812 11:10:45.319450 13138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:45.306557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56474 (local address 127.4.26.126:41261)
0812 11:10:45.307815 (+ 1258us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:45.307833 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:45.307894 (+ 61us) server_negotiation.cc:407] Connection header received
0812 11:10:45.309787 (+ 1893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:45.309824 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:45.310477 (+ 653us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:45.310946 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:45.311628 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:45.313024 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:45.314557 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:45.315379 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:45.315606 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:45.316868 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:45.316876 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:45.316895 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:45.317580 (+ 685us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:45.317674 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:45.317700 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:45.317810 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:45.318068 (+ 258us) server_negotiation.cc:299] Negotiation successful
0812 11:10:45.318416 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":710,"thread_start_us":444,"threads_started":1}
I20260812 11:10:45.320881 13135 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:45.322149 13135 log.cc:824] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:45.324039 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:45.325493 13135 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85: No bootstrap required, opened a new log
I20260812 11:10:45.333096 13135 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab175173559a4770ad469820fb060a85" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41261 } }
I20260812 11:10:45.333603 13135 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:45.333732 13135 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab175173559a4770ad469820fb060a85, State: Initialized, Role: FOLLOWER
I20260812 11:10:45.334419 13135 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab175173559a4770ad469820fb060a85" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41261 } }
I20260812 11:10:45.334666 13135 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:45.334774 13135 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:45.334918 13135 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:45.337193 13135 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab175173559a4770ad469820fb060a85" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41261 } }
I20260812 11:10:45.337751 13135 leader_election.cc:302] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab175173559a4770ad469820fb060a85; no voters:
I20260812 11:10:45.338315 13135 leader_election.cc:288] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:45.338487 13142 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:45.339316 13142 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [term 1 LEADER]: Becoming Leader. State: Replica: ab175173559a4770ad469820fb060a85, State: Running, Role: LEADER
I20260812 11:10:45.339936 13142 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab175173559a4770ad469820fb060a85" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41261 } }
I20260812 11:10:45.340555 13135 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:45.343466 13147 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab175173559a4770ad469820fb060a85. Latest consensus state: current_term: 1 leader_uuid: "ab175173559a4770ad469820fb060a85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab175173559a4770ad469820fb060a85" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41261 } } }
I20260812 11:10:45.344025 13147 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:45.344895 13143 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab175173559a4770ad469820fb060a85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab175173559a4770ad469820fb060a85" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41261 } } }
I20260812 11:10:45.345373 13143 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:45.347551 13156 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:45.352937 13156 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:45.363317 13156 catalog_manager.cc:1347] Generated new cluster ID: 48f29654937e48fa93700e065955678c
I20260812 11:10:45.363519 13156 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:45.372399 13156 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:45.374392 13156 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:45.397262 13156 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab175173559a4770ad469820fb060a85: Generated new TSK 0
I20260812 11:10:45.398659 13156 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260812 11:10:45.439730 13187 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260812 11:10:45.439961 13187 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 11:10:45.441210 13138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:45.420605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56476 (local address 127.4.26.126:41261)
0812 11:10:45.420814 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:45.420821 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:45.421186 (+ 365us) server_negotiation.cc:407] Connection header received
0812 11:10:45.421457 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:45.421464 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:45.421585 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:45.421791 (+ 206us) server_negotiation.cc:226] Negotiated authn=JWT
0812 11:10:45.422302 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:45.423452 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:45.424885 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:45.425640 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:45.425777 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:45.426434 (+ 657us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 11:10:45.440499 (+ 14065us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35617/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 11:10:45.440929 (+ 430us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56476: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35617/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":79}
W20260812 11:10:45.441352 13138 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56476: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35617/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260812 11:10:45.441700 13186 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:45.420439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41261 (local address 127.0.0.1:56476)
0812 11:10:45.421059 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:45.421079 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:45.421261 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:45.421804 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:45.421808 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:45.421819 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0812 11:10:45.422098 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:45.422107 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:45.423590 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:45.423594 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:45.424738 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:45.424751 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:45.425839 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:45.425845 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:45.426010 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:45.426050 (+ 40us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 11:10:45.440798 (+ 14748us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35617/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0812 11:10:45.441121 (+ 323us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.4.26.126:41261: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35617/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":327,"threads_started":1}
I20260812 11:10:45.443006 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 13020
I20260812 11:10:45.444314 13127 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:45.541572 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 13020
2026-08-12T11:10:45Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (818 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260812 11:10:45.606421 4201 mini_oidc.cc:152] Starting JWKS server
I20260812 11:10:45.608920 4201 webserver.cc:460] Webserver started at https://127.0.0.1:41331/ using document root <none> and password file <none>
I20260812 11:10:45.609246 4201 mini_oidc.cc:189] Starting OIDC Discovery server
I20260812 11:10:45.609946 4201 webserver.cc:460] Webserver started at http://127.0.0.1:34899/ using document root <none> and password file <none>
2026-08-12T11:10:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:45Z Disabled control of system clock
I20260812 11:10:45.643848 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:41903
--webserver_interface=127.4.26.126
--webserver_port=0
--builtin_ntp_servers=127.4.26.84:41285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:41903
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41331/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 11:10:45.995363 13197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:45.995752 13197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:45.995894 13197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:46.003650 13197 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:46.003824 13197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:46.003893 13197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:46.003996 13197 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:46.004058 13197 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 11:10:46.004160 13197 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 11:10:46.004221 13197 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41331/jwks.json
I20260812 11:10:46.014525 13197 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:41285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:41903
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:41903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41331/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:46.015995 13197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:46.017939 13197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:46.030916 13203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:46.030952 13205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:46.030876 13207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:46.031877 13197 server_base.cc:1034] running on GCE node
I20260812 11:10:46.032769 13197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:46.034381 13197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:46.035655 13197 hybrid_clock.cc:648] HybridClock initialized: now 1786533046035589 us; error 55 us; skew 500 ppm
I20260812 11:10:46.036090 13197 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:10:46.038852 13197 webserver.cc:460] Webserver started at http://127.4.26.126:33811/ using document root <none> and password file <none>
I20260812 11:10:46.039657 13197 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:46.039783 13197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:46.040129 13197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:46.043371 13197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "af0d6a3656c14ce39af6f36f779025fa"
format_stamp: "Formatted at 2026-08-12 11:10:46 on dist-test-slave-rmhg"
server_key: "2edca8354a3d7b6792101de7ac48d19d"
server_key_iv: "45ed184861650e026091a447afec2fc1"
server_key_version: "encryptionkey@0"
I20260812 11:10:46.044287 13197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "af0d6a3656c14ce39af6f36f779025fa"
format_stamp: "Formatted at 2026-08-12 11:10:46 on dist-test-slave-rmhg"
server_key: "2edca8354a3d7b6792101de7ac48d19d"
server_key_iv: "45ed184861650e026091a447afec2fc1"
server_key_version: "encryptionkey@0"
I20260812 11:10:46.050329 13197 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260812 11:10:46.054502 13219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:46.056222 13197 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.001s
I20260812 11:10:46.056432 13197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "af0d6a3656c14ce39af6f36f779025fa"
format_stamp: "Formatted at 2026-08-12 11:10:46 on dist-test-slave-rmhg"
server_key: "2edca8354a3d7b6792101de7ac48d19d"
server_key_iv: "45ed184861650e026091a447afec2fc1"
server_key_version: "encryptionkey@0"
I20260812 11:10:46.056685 13197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:46.073107 13197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:46.074142 13197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:46.074451 13197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:46.093783 13197 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:41903
I20260812 11:10:46.093813 13299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:41903 every 8 connection(s)
I20260812 11:10:46.095299 13197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:46.098953 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 13197
I20260812 11:10:46.099202 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:10:46.100040 4201 external_mini_cluster.cc:1428] Setting key 04f6821f6017514db83a37cd8662fbb7
I20260812 11:10:46.100066 13300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:46.114423 13304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:46.101966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47550 (local address 127.4.26.126:41903)
0812 11:10:46.102965 (+ 999us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:46.102998 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:46.103049 (+ 51us) server_negotiation.cc:407] Connection header received
0812 11:10:46.104715 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:46.104742 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:46.105383 (+ 641us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:46.105823 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:46.106459 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:46.107906 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:46.109377 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:46.110146 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:46.110336 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:46.111568 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:46.111577 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:46.111598 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:46.112282 (+ 684us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:46.112381 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:46.112405 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:46.112522 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:46.112787 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 11:10:46.113287 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":313,"threads_started":1}
I20260812 11:10:46.114550 13300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa: Bootstrap starting.
I20260812 11:10:46.118443 13300 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:46.119220 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:46.119810 13300 log.cc:824] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:46.123137 13300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa: No bootstrap required, opened a new log
I20260812 11:10:46.131284 13300 raft_consensus.cc:348] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af0d6a3656c14ce39af6f36f779025fa" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41903 } }
I20260812 11:10:46.131716 13300 raft_consensus.cc:374] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:46.131831 13300 raft_consensus.cc:729] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af0d6a3656c14ce39af6f36f779025fa, State: Initialized, Role: FOLLOWER
I20260812 11:10:46.132539 13300 consensus_queue.cc:260] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af0d6a3656c14ce39af6f36f779025fa" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41903 } }
I20260812 11:10:46.132831 13300 raft_consensus.cc:388] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:46.132992 13300 raft_consensus.cc:482] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:46.133258 13300 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:46.135576 13300 raft_consensus.cc:504] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af0d6a3656c14ce39af6f36f779025fa" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41903 } }
I20260812 11:10:46.136161 13300 leader_election.cc:302] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af0d6a3656c14ce39af6f36f779025fa; no voters:
I20260812 11:10:46.136802 13300 leader_election.cc:288] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:46.136974 13313 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:46.137811 13313 raft_consensus.cc:686] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [term 1 LEADER]: Becoming Leader. State: Replica: af0d6a3656c14ce39af6f36f779025fa, State: Running, Role: LEADER
I20260812 11:10:46.138367 13313 consensus_queue.cc:237] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af0d6a3656c14ce39af6f36f779025fa" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41903 } }
I20260812 11:10:46.139145 13300 sys_catalog.cc:564] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:46.141463 13317 sys_catalog.cc:455] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader af0d6a3656c14ce39af6f36f779025fa. Latest consensus state: current_term: 1 leader_uuid: "af0d6a3656c14ce39af6f36f779025fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af0d6a3656c14ce39af6f36f779025fa" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41903 } } }
I20260812 11:10:46.141448 13314 sys_catalog.cc:455] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af0d6a3656c14ce39af6f36f779025fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af0d6a3656c14ce39af6f36f779025fa" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41903 } } }
I20260812 11:10:46.141995 13314 sys_catalog.cc:458] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:46.143518 13324 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:46.143518 13317 sys_catalog.cc:458] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:46.149278 13324 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:46.159309 13324 catalog_manager.cc:1347] Generated new cluster ID: da80c2eaeba846dd9b7f9f345c9c8864
I20260812 11:10:46.159448 13324 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:46.184686 13324 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:46.186125 13324 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:46.193663 13324 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af0d6a3656c14ce39af6f36f779025fa: Generated new TSK 0
I20260812 11:10:46.194890 13324 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:46.229336 13304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:46.220057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47564 (local address 127.4.26.126:41903)
0812 11:10:46.220267 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:46.220278 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:46.220541 (+ 263us) server_negotiation.cc:407] Connection header received
0812 11:10:46.220904 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:46.220911 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:46.221026 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:46.221242 (+ 216us) server_negotiation.cc:226] Negotiated authn=JWT
0812 11:10:46.221688 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:46.222843 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:46.224499 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:46.225272 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:46.225415 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:46.225992 (+ 577us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 11:10:46.228563 (+ 2571us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41331/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 11:10:46.228973 (+ 410us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47564: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41331/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":80}
W20260812 11:10:46.229485 13304 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47564: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41331/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260812 11:10:46.230937 13354 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:46.219814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41903 (local address 127.0.0.1:47564)
0812 11:10:46.220435 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:46.220452 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:46.220595 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:46.221249 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:46.221252 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:46.221263 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0812 11:10:46.221536 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:46.221545 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:46.223000 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:46.223005 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:46.224312 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:46.224332 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:46.225474 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:46.225479 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:46.225641 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:46.225689 (+ 48us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 11:10:46.228824 (+ 3135us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41331/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0812 11:10:46.230459 (+ 1635us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.4.26.126:41903: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41331/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":1265,"thread_start_us":325,"threads_started":1}
I20260812 11:10:46.232684 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 13197
I20260812 11:10:46.234186 13293 generic_service.cc:196] Checking for leaks (request via RPC)
E20260812 11:10:46.240736 13355 webserver.cc:533] Webserver: sslize failed:
E20260812 11:10:46.240859 13355 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260812 11:10:46.328945 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 13197
2026-08-12T11:10:46Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (787 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-12T11:10:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:46Z Disabled control of system clock
I20260812 11:10:46.428973 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:40589
--webserver_interface=127.4.26.126
--webserver_port=0
--builtin_ntp_servers=127.4.26.84:40821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:40589
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/testchainca.cert with env {}
W20260812 11:10:46.778980 13363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:46.779361 13363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:46.779497 13363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:46.787147 13363 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:46.787305 13363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:46.787379 13363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:46.787463 13363 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:46.787523 13363 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260812 11:10:46.787622 13363 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260812 11:10:46.787674 13363 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260812 11:10:46.799021 13363 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:40589
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:40589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:46.800580 13363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:46.802064 13363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:46.815205 13368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:46.815199 13372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:46.815177 13369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:46.816084 13363 server_base.cc:1034] running on GCE node
I20260812 11:10:46.817030 13363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:46.818737 13363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:46.819978 13363 hybrid_clock.cc:648] HybridClock initialized: now 1786533046819907 us; error 69 us; skew 500 ppm
I20260812 11:10:46.820375 13363 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:10:46.827260 13363 webserver.cc:460] Webserver started at http://127.4.26.126:39475/ using document root <none> and password file <none>
I20260812 11:10:46.828121 13363 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:46.828246 13363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:46.828708 13363 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:46.832103 13363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "5d48b50766ee48f68692a972939d9a55"
format_stamp: "Formatted at 2026-08-12 11:10:46 on dist-test-slave-rmhg"
server_key: "b5221c3b9438a6990d86e04947e0043b"
server_key_iv: "1f3507cb69aea972396aa0a394595252"
server_key_version: "encryptionkey@0"
I20260812 11:10:46.833017 13363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "5d48b50766ee48f68692a972939d9a55"
format_stamp: "Formatted at 2026-08-12 11:10:46 on dist-test-slave-rmhg"
server_key: "b5221c3b9438a6990d86e04947e0043b"
server_key_iv: "1f3507cb69aea972396aa0a394595252"
server_key_version: "encryptionkey@0"
I20260812 11:10:46.839181 13363 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260812 11:10:46.843338 13379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:46.845260 13363 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:10:46.845522 13363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "5d48b50766ee48f68692a972939d9a55"
format_stamp: "Formatted at 2026-08-12 11:10:46 on dist-test-slave-rmhg"
server_key: "b5221c3b9438a6990d86e04947e0043b"
server_key_iv: "1f3507cb69aea972396aa0a394595252"
server_key_version: "encryptionkey@0"
I20260812 11:10:46.845782 13363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:46.859879 13363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:46.860859 13363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:46.861325 13363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:46.880589 13363 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:40589
I20260812 11:10:46.880607 13463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:40589 every 8 connection(s)
I20260812 11:10:46.882109 13363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:46.882735 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 13363
I20260812 11:10:46.882926 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:10:46.883751 4201 external_mini_cluster.cc:1428] Setting key 9f083611be128cb327acca636dca2e11
I20260812 11:10:46.886961 13464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:46.900628 13467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:46.885889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50960 (local address 127.4.26.126:40589)
0812 11:10:46.886989 (+ 1100us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:46.887007 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:46.887068 (+ 61us) server_negotiation.cc:407] Connection header received
0812 11:10:46.889403 (+ 2335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:46.889439 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:46.890105 (+ 666us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:46.890625 (+ 520us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:46.891262 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:46.893362 (+ 2100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:46.894858 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:46.895944 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:46.896154 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:46.897371 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:46.897382 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:46.897405 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:10:46.898205 (+ 800us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:46.898328 (+ 123us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:10:46.898359 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:46.898485 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:46.898759 (+ 274us) server_negotiation.cc:299] Negotiation successful
0812 11:10:46.899222 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":316,"threads_started":1}
I20260812 11:10:46.901883 13464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55: Bootstrap starting.
I20260812 11:10:46.905367 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:10:46.906038 13464 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:46.907434 13464 log.cc:824] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:46.911056 13464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55: No bootstrap required, opened a new log
I20260812 11:10:46.919168 13464 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d48b50766ee48f68692a972939d9a55" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40589 } }
I20260812 11:10:46.919611 13464 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:46.919704 13464 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d48b50766ee48f68692a972939d9a55, State: Initialized, Role: FOLLOWER
I20260812 11:10:46.920300 13464 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d48b50766ee48f68692a972939d9a55" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40589 } }
I20260812 11:10:46.920552 13464 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:46.920663 13464 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:46.920816 13464 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:46.923312 13464 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d48b50766ee48f68692a972939d9a55" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40589 } }
I20260812 11:10:46.924088 13464 leader_election.cc:302] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d48b50766ee48f68692a972939d9a55; no voters:
I20260812 11:10:46.924885 13464 leader_election.cc:288] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:46.925020 13472 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:46.926295 13472 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [term 1 LEADER]: Becoming Leader. State: Replica: 5d48b50766ee48f68692a972939d9a55, State: Running, Role: LEADER
I20260812 11:10:46.926856 13472 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d48b50766ee48f68692a972939d9a55" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40589 } }
I20260812 11:10:46.927351 13464 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:46.929895 13477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d48b50766ee48f68692a972939d9a55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d48b50766ee48f68692a972939d9a55" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40589 } } }
I20260812 11:10:46.929917 13475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d48b50766ee48f68692a972939d9a55. Latest consensus state: current_term: 1 leader_uuid: "5d48b50766ee48f68692a972939d9a55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d48b50766ee48f68692a972939d9a55" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40589 } } }
I20260812 11:10:46.930469 13475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:46.930475 13477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:46.931491 13488 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:46.939389 13488 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:46.950150 13488 catalog_manager.cc:1347] Generated new cluster ID: 53742f79e03542748ae3d0948a432016
I20260812 11:10:46.950314 13488 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:46.963948 13488 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:46.966240 13488 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:46.983407 13488 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d48b50766ee48f68692a972939d9a55: Generated new TSK 0
I20260812 11:10:46.984776 13488 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:10:47.043932 13467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:47.005739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50970 (local address 127.4.26.126:40589)
0812 11:10:47.005969 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:47.005986 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:47.006328 (+ 342us) server_negotiation.cc:407] Connection header received
0812 11:10:47.006598 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:47.006605 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:47.006718 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:47.006915 (+ 197us) server_negotiation.cc:226] Negotiated authn=JWT
0812 11:10:47.007498 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:47.008681 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:47.010432 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:47.011202 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:47.011358 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:47.012013 (+ 655us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0812 11:10:47.043101 (+ 31088us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 11:10:47.043602 (+ 501us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50970: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":87}
W20260812 11:10:47.044128 13467 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50970: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260812 11:10:47.044234 13509 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:47.005558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40589 (local address 127.0.0.1:50970)
0812 11:10:47.006213 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:47.006231 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:47.006378 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:47.006978 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:47.006982 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:47.006995 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0812 11:10:47.007313 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:47.007322 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:47.008914 (+ 1592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:47.008920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:47.010249 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:47.010268 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:47.011444 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:47.011451 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:47.011636 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:47.011679 (+ 43us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0812 11:10:47.043464 (+ 31785us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0812 11:10:47.043816 (+ 352us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.4.26.126:40589: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":342,"threads_started":1}
I20260812 11:10:47.045454 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 13363
I20260812 11:10:47.046880 13457 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:47.144529 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 13363
2026-08-12T11:10:47Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (798 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (435 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (1563 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:49 dist-test-slave-rmhg krb5kdc[13533](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:49 dist-test-slave-rmhg krb5kdc[13533](info): set up 2 sockets
Aug 12 11:10:49 dist-test-slave-rmhg krb5kdc[13533](info): commencing operation
krb5kdc: starting...
W20260812 11:10:50.404353 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.212s user 0.000s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:10:50 dist-test-slave-rmhg krb5kdc[13533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:10:50.652814 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:36343
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:45611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:36343
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:51.006779 13556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:51.007115 13556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:51.007239 13556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:51.014703 13556 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:51.014842 13556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:51.014890 13556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:51.014973 13556 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:51.015033 13556 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:51.026070 13556 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:45611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:36343
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:36343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:51.027645 13556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:51.029367 13556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:51.042574 13568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:51.042510 13570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:51.042546 13574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:51.043290 13556 server_base.cc:1034] running on GCE node
I20260812 11:10:51.044176 13556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:51.045832 13556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:51.047075 13556 hybrid_clock.cc:648] HybridClock initialized: now 1786533051047010 us; error 55 us; skew 500 ppm
I20260812 11:10:51.047466 13556 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:51 dist-test-slave-rmhg krb5kdc[13533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533051, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:51.050944 13556 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:10:51.052531 13556 webserver.cc:460] Webserver started at http://127.4.26.126:37671/ using document root <none> and password file <none>
I20260812 11:10:51.053292 13556 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:51.053426 13556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:51.053750 13556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:51.056902 13556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "7af7038e8422486590a1f89446a1da42"
format_stamp: "Formatted at 2026-08-12 11:10:51 on dist-test-slave-rmhg"
server_key: "135f5168139512e8bde68753038cab38"
server_key_iv: "14d64b2deab4865f2437beaef4dc3a3e"
server_key_version: "encryptionkey@0"
I20260812 11:10:51.057758 13556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "7af7038e8422486590a1f89446a1da42"
format_stamp: "Formatted at 2026-08-12 11:10:51 on dist-test-slave-rmhg"
server_key: "135f5168139512e8bde68753038cab38"
server_key_iv: "14d64b2deab4865f2437beaef4dc3a3e"
server_key_version: "encryptionkey@0"
I20260812 11:10:51.063421 13556 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:10:51.067328 13594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:51.069027 13556 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260812 11:10:51.069278 13556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "7af7038e8422486590a1f89446a1da42"
format_stamp: "Formatted at 2026-08-12 11:10:51 on dist-test-slave-rmhg"
server_key: "135f5168139512e8bde68753038cab38"
server_key_iv: "14d64b2deab4865f2437beaef4dc3a3e"
server_key_version: "encryptionkey@0"
I20260812 11:10:51.069494 13556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:51.091135 13556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:51.095835 13556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:51.096153 13556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:51.115572 13556 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:36343
I20260812 11:10:51.115626 13678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:36343 every 8 connection(s)
I20260812 11:10:51.117403 13556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:51.117977 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 13556
I20260812 11:10:51.118223 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:10:51.118865 4201 external_mini_cluster.cc:1428] Setting key 39757b4239bf38c297ccad7929a68112
I20260812 11:10:51.122833 13680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 11:10:51 dist-test-slave-rmhg krb5kdc[13533](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533050, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:51.136756 13680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42: Bootstrap starting.
I20260812 11:10:51.140623 13680 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:51.142033 13680 log.cc:824] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:51.144737 13684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:51.121022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51616 (local address 127.4.26.126:36343)
0812 11:10:51.121902 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:51.121918 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:51.121974 (+ 56us) server_negotiation.cc:407] Connection header received
0812 11:10:51.124466 (+ 2492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:51.124500 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:51.125060 (+ 560us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:51.125585 (+ 525us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:51.127083 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:51.129394 (+ 2311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:51.130897 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:51.131996 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:51.132201 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:51.136745 (+ 4544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:51.136755 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:51.136774 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:51.136826 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:51.140117 (+ 3291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:51.141099 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:51.141107 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:51.141118 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:51.141358 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:51.141807 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:51.141814 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:51.141816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:51.142453 (+ 637us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:51.142778 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:51.143260 (+ 482us) server_negotiation.cc:299] Negotiation successful
0812 11:10:51.143711 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":362,"threads_started":1}
I20260812 11:10:51.145354 13680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42: No bootstrap required, opened a new log
I20260812 11:10:51.154343 13680 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af7038e8422486590a1f89446a1da42" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 36343 } }
I20260812 11:10:51.154892 13680 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:51.155019 13680 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7af7038e8422486590a1f89446a1da42, State: Initialized, Role: FOLLOWER
I20260812 11:10:51.155779 13680 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af7038e8422486590a1f89446a1da42" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 36343 } }
I20260812 11:10:51.156025 13680 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:51.156134 13680 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:51.156277 13680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:51.158561 13680 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af7038e8422486590a1f89446a1da42" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 36343 } }
I20260812 11:10:51.159153 13680 leader_election.cc:302] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7af7038e8422486590a1f89446a1da42; no voters:
I20260812 11:10:51.159798 13680 leader_election.cc:288] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:51.159942 13686 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:51.160701 13686 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [term 1 LEADER]: Becoming Leader. State: Replica: 7af7038e8422486590a1f89446a1da42, State: Running, Role: LEADER
I20260812 11:10:51.161343 13686 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af7038e8422486590a1f89446a1da42" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 36343 } }
I20260812 11:10:51.162226 13680 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:51.164142 13688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7af7038e8422486590a1f89446a1da42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af7038e8422486590a1f89446a1da42" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 36343 } } }
I20260812 11:10:51.165187 13688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:51.164865 13689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7af7038e8422486590a1f89446a1da42. Latest consensus state: current_term: 1 leader_uuid: "7af7038e8422486590a1f89446a1da42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7af7038e8422486590a1f89446a1da42" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 36343 } } }
I20260812 11:10:51.165722 13689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:51.169445 13703 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:51.175369 13703 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:51.185567 13703 catalog_manager.cc:1347] Generated new cluster ID: 476f890b1a364acda2b13fc86383d7bd
I20260812 11:10:51.185727 13703 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:51.202368 13703 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:51.203950 13703 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:51.227916 13703 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7af7038e8422486590a1f89446a1da42: Generated new TSK 0
I20260812 11:10:51.228891 13703 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:10:51.304322 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:36343
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:45611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:51.664799 13720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:51.665144 13720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:51.665331 13720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:51.673779 13720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:51.673938 13720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:51.674106 13720 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:10:51.684691 13720 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:45611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:36343
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:51.686185 13720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:51.687620 13720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:51.701660 13728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:51.702221 13733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:51.702415 13727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:51.707235 13720 server_base.cc:1034] running on GCE node
I20260812 11:10:51.708065 13720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:51.709221 13720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:51.710474 13720 hybrid_clock.cc:648] HybridClock initialized: now 1786533051710406 us; error 55 us; skew 500 ppm
I20260812 11:10:51.710860 13720 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:51 dist-test-slave-rmhg krb5kdc[13533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533051, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:51.714624 13720 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:10:51.716410 13720 webserver.cc:460] Webserver started at http://127.4.26.65:37501/ using document root <none> and password file <none>
I20260812 11:10:51.717259 13720 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:51.717382 13720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:51.717716 13720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:51.720957 13720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "46dcb1ec6d514af385b66173c834c381"
format_stamp: "Formatted at 2026-08-12 11:10:51 on dist-test-slave-rmhg"
server_key: "191954a16c58bb2896d1346bdf1e1505"
server_key_iv: "511848742be9fdbb2e7a1d3d3dd6c4fe"
server_key_version: "encryptionkey@0"
I20260812 11:10:51.722258 13720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "46dcb1ec6d514af385b66173c834c381"
format_stamp: "Formatted at 2026-08-12 11:10:51 on dist-test-slave-rmhg"
server_key: "191954a16c58bb2896d1346bdf1e1505"
server_key_iv: "511848742be9fdbb2e7a1d3d3dd6c4fe"
server_key_version: "encryptionkey@0"
I20260812 11:10:51.728763 13720 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260812 11:10:51.733098 13743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:51.734910 13720 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:10:51.735133 13720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "46dcb1ec6d514af385b66173c834c381"
format_stamp: "Formatted at 2026-08-12 11:10:51 on dist-test-slave-rmhg"
server_key: "191954a16c58bb2896d1346bdf1e1505"
server_key_iv: "511848742be9fdbb2e7a1d3d3dd6c4fe"
server_key_version: "encryptionkey@0"
I20260812 11:10:51.735374 13720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:51.751487 13720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:51.756397 13720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:51.756727 13720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:51.757910 13720 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:51.759480 13720 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:51.759570 13720 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:51.759696 13720 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:51.759750 13720 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:51.793511 13720 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:40127
I20260812 11:10:51.793560 13922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:40127 every 8 connection(s)
I20260812 11:10:51.794875 13720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:51.803705 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 13720
I20260812 11:10:51.803932 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:51.804745 4201 external_mini_cluster.cc:1428] Setting key 33337e8b46729102bcfb1e41f5343f2f
Aug 12 11:10:51 dist-test-slave-rmhg krb5kdc[13533](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533051, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:51.818006 13931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:51.797761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:33783 (local address 127.4.26.126:36343)
0812 11:10:51.798303 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:51.798310 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:51.799427 (+ 1117us) server_negotiation.cc:407] Connection header received
0812 11:10:51.801334 (+ 1907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:51.801339 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:51.801415 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:51.801505 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:51.803222 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:51.804349 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:51.806524 (+ 2175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:51.807093 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:51.807241 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:51.810965 (+ 3724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:51.810973 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:51.810977 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:51.811023 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:51.814195 (+ 3172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:51.815112 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:51.815119 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:51.815122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:51.815287 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:51.815782 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:51.815787 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:51.815791 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:51.816196 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:51.816370 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:51.817487 (+ 1117us) server_negotiation.cc:299] Negotiation successful
0812 11:10:51.817725 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":258,"threads_started":1}
I20260812 11:10:51.819582 13933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:51.798370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:36343 (local address 127.4.26.65:33783)
0812 11:10:51.799235 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:51.799278 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:51.800972 (+ 1694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:51.801728 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:51.801738 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:51.802335 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:51.802985 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:51.803005 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:51.804566 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:51.804571 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:51.806371 (+ 1800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:51.806390 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:51.807328 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:51.807333 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:51.807551 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:51.808264 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:51.808289 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:51.810684 (+ 2395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:51.814403 (+ 3719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:51.814413 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:51.814431 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:51.814958 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:51.815397 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:51.815400 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:51.815402 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:51.815661 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:51.816398 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:51.816406 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:51.816959 (+ 553us) client_negotiation.cc:769] Sending connection context
0812 11:10:51.817336 (+ 377us) client_negotiation.cc:240] Negotiation successful
0812 11:10:51.817964 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":327,"threads_started":1}
I20260812 11:10:51.821404 13926 heartbeater.cc:347] Connected to a master server at 127.4.26.126:36343
I20260812 11:10:51.821758 13926 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:51.822774 13926 heartbeater.cc:511] Master 127.4.26.126:36343 requested a full tablet report, sending...
I20260812 11:10:51.825337 13623 ts_manager.cc:194] Registered new tserver with Master: 46dcb1ec6d514af385b66173c834c381 (127.4.26.65:40127)
I20260812 11:10:51.826929 13623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:33783
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:10:51.862859 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:36343
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:45611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:52.207348 13940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:52.207701 13940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:52.207836 13940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:52.215674 13940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:52.215821 13940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:52.215986 13940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:10:52.226423 13940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:45611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:36343
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:52.227813 13940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:52.229211 13940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:52.243119 13948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:52.243052 13952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:52.243091 13950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:52.244410 13940 server_base.cc:1034] running on GCE node
I20260812 11:10:52.245194 13940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:52.246309 13940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:52.247570 13940 hybrid_clock.cc:648] HybridClock initialized: now 1786533052247511 us; error 38 us; skew 500 ppm
I20260812 11:10:52.247934 13940 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:52 dist-test-slave-rmhg krb5kdc[13533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:52.254755 13940 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:10:52.256539 13940 webserver.cc:460] Webserver started at http://127.4.26.66:34485/ using document root <none> and password file <none>
I20260812 11:10:52.257387 13940 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:52.257537 13940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:52.257885 13940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:52.261469 13940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "6c789e696b5346679761de3b48a7515f"
format_stamp: "Formatted at 2026-08-12 11:10:52 on dist-test-slave-rmhg"
server_key: "8c1f564e7819a8525d41d343deb4d7ee"
server_key_iv: "d8cb08df448143a81f8565f63a4351c1"
server_key_version: "encryptionkey@0"
I20260812 11:10:52.262441 13940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "6c789e696b5346679761de3b48a7515f"
format_stamp: "Formatted at 2026-08-12 11:10:52 on dist-test-slave-rmhg"
server_key: "8c1f564e7819a8525d41d343deb4d7ee"
server_key_iv: "d8cb08df448143a81f8565f63a4351c1"
server_key_version: "encryptionkey@0"
I20260812 11:10:52.268668 13940 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.002s
I20260812 11:10:52.272604 13964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:52.274200 13940 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:52.274387 13940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "6c789e696b5346679761de3b48a7515f"
format_stamp: "Formatted at 2026-08-12 11:10:52 on dist-test-slave-rmhg"
server_key: "8c1f564e7819a8525d41d343deb4d7ee"
server_key_iv: "d8cb08df448143a81f8565f63a4351c1"
server_key_version: "encryptionkey@0"
I20260812 11:10:52.274608 13940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:52.298872 13940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:52.303676 13940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:52.303987 13940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:52.305130 13940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:52.306721 13940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:52.306806 13940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:52.306931 13940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:52.306982 13940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:52.340402 13940 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:37587
I20260812 11:10:52.340474 14163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:37587 every 8 connection(s)
I20260812 11:10:52.341823 13940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:52.348380 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 13940
I20260812 11:10:52.348569 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:52.349092 4201 external_mini_cluster.cc:1428] Setting key a6357c6452338278776bf969f49efdc4
Aug 12 11:10:52 dist-test-slave-rmhg krb5kdc[13533](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:52.364688 14168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.344502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:54557 (local address 127.4.26.126:36343)
0812 11:10:52.344946 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.344950 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.346095 (+ 1145us) server_negotiation.cc:407] Connection header received
0812 11:10:52.348019 (+ 1924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.348025 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.348147 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.348284 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.350056 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.350910 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.352771 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.353413 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.353538 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.357511 (+ 3973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.357518 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.357523 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.357569 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.360547 (+ 2978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.361775 (+ 1228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.361781 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.361784 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.361979 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.362609 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.362613 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.362615 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.362981 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.363140 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.364118 (+ 978us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.364339 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":220,"threads_started":1}
I20260812 11:10:52.366178 14172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.345104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:36343 (local address 127.4.26.66:54557)
0812 11:10:52.345900 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.345957 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:52.347694 (+ 1737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:52.348557 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:52.348571 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:52.349258 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:52.349896 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.349916 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.351062 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.351068 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.352602 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.352617 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.353649 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.353655 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.353874 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.354551 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:52.354578 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:52.357197 (+ 2619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:52.360748 (+ 3551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.360759 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.360782 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.361510 (+ 728us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.362130 (+ 620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.362135 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.362138 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.362453 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.363122 (+ 669us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:52.363131 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:52.363626 (+ 495us) client_negotiation.cc:769] Sending connection context
0812 11:10:52.363987 (+ 361us) client_negotiation.cc:240] Negotiation successful
0812 11:10:52.364625 (+ 638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":295,"threads_started":1}
I20260812 11:10:52.367952 14165 heartbeater.cc:347] Connected to a master server at 127.4.26.126:36343
I20260812 11:10:52.368302 14165 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:52.369133 14165 heartbeater.cc:511] Master 127.4.26.126:36343 requested a full tablet report, sending...
I20260812 11:10:52.371031 13623 ts_manager.cc:194] Registered new tserver with Master: 6c789e696b5346679761de3b48a7515f (127.4.26.66:37587)
I20260812 11:10:52.372231 13623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:54557
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:10:52.406541 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:36343
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:45611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:52.752172 14177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:52.752507 14177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:52.752646 14177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:52.760300 14177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:52.760468 14177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:52.760629 14177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:10:52.771209 14177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:45611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:36343
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:52.772688 14177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:52.774204 14177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:52.788637 14182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:52.788770 14187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:52.788805 14183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:52.789726 14177 server_base.cc:1034] running on GCE node
I20260812 11:10:52.790388 14177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:52.791520 14177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:52.792742 14177 hybrid_clock.cc:648] HybridClock initialized: now 1786533052792685 us; error 48 us; skew 500 ppm
I20260812 11:10:52.793176 14177 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:52 dist-test-slave-rmhg krb5kdc[13533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:52.797256 14177 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:10:52.802599 14177 webserver.cc:460] Webserver started at http://127.4.26.67:46883/ using document root <none> and password file <none>
I20260812 11:10:52.803365 14177 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:52.803494 14177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:52.803799 14177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:52.808179 14177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "a567ba4df6d4417999f5a95302a84dd4"
format_stamp: "Formatted at 2026-08-12 11:10:52 on dist-test-slave-rmhg"
server_key: "7a96dd03701f9523e3d560c7cdfa9872"
server_key_iv: "1748b593de3fd2732859579a25b4ac74"
server_key_version: "encryptionkey@0"
I20260812 11:10:52.809379 14177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "a567ba4df6d4417999f5a95302a84dd4"
format_stamp: "Formatted at 2026-08-12 11:10:52 on dist-test-slave-rmhg"
server_key: "7a96dd03701f9523e3d560c7cdfa9872"
server_key_iv: "1748b593de3fd2732859579a25b4ac74"
server_key_version: "encryptionkey@0"
I20260812 11:10:52.816963 14177 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260812 11:10:52.821014 14196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:52.822669 14177 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:52.822861 14177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "a567ba4df6d4417999f5a95302a84dd4"
format_stamp: "Formatted at 2026-08-12 11:10:52 on dist-test-slave-rmhg"
server_key: "7a96dd03701f9523e3d560c7cdfa9872"
server_key_iv: "1748b593de3fd2732859579a25b4ac74"
server_key_version: "encryptionkey@0"
I20260812 11:10:52.823087 14177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:52.830982 13926 heartbeater.cc:503] Master 127.4.26.126:36343 was elected leader, sending a full tablet report...
I20260812 11:10:52.842769 14177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:52.847358 14177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:52.847633 14177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:52.848657 14177 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:52.850291 14177 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:52.850368 14177 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:52.850461 14177 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:52.850504 14177 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:52.883970 14177 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:36435
I20260812 11:10:52.884021 14379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:36435 every 8 connection(s)
I20260812 11:10:52.885380 14177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:52.891382 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 14177
I20260812 11:10:52.891584 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:52.892144 4201 external_mini_cluster.cc:1428] Setting key 50bcf7295a35bf09c9ff4aede7d0b258
Aug 12 11:10:52 dist-test-slave-rmhg krb5kdc[13533](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:10:52.908010 14382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.888081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:51913 (local address 127.4.26.126:36343)
0812 11:10:52.888539 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.888544 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.889663 (+ 1119us) server_negotiation.cc:407] Connection header received
0812 11:10:52.891878 (+ 2215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.891883 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.891972 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.892095 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.894610 (+ 2515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.895783 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.897582 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.898160 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.898280 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.902089 (+ 3809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.902094 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.902097 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.902148 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.904620 (+ 2472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.905502 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.905508 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.905510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.905644 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.906097 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.906101 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.906103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.906422 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.906560 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.907376 (+ 816us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.907617 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":242,"threads_started":1}
I20260812 11:10:52.909126 14384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.888574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:36343 (local address 127.4.26.67:51913)
0812 11:10:52.889460 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:52.889519 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:52.891487 (+ 1968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:52.892437 (+ 950us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:52.892451 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:52.893311 (+ 860us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:52.894311 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.894340 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.895953 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.895959 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.897428 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:52.897442 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.898409 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.898417 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:52.898671 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.899340 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:52.899373 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:52.901802 (+ 2429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:52.904787 (+ 2985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.904799 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.904817 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.905357 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.905757 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:52.905761 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:52.905763 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:52.905964 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:52.906555 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:52.906564 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:52.906954 (+ 390us) client_negotiation.cc:769] Sending connection context
0812 11:10:52.907219 (+ 265us) client_negotiation.cc:240] Negotiation successful
0812 11:10:52.907834 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":359,"threads_started":1}
I20260812 11:10:52.910655 14380 heartbeater.cc:347] Connected to a master server at 127.4.26.126:36343
I20260812 11:10:52.911020 14380 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:52.911849 14380 heartbeater.cc:511] Master 127.4.26.126:36343 requested a full tablet report, sending...
I20260812 11:10:52.913488 13623 ts_manager.cc:194] Registered new tserver with Master: a567ba4df6d4417999f5a95302a84dd4 (127.4.26.67:36435)
I20260812 11:10:52.914337 13623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:51913
I20260812 11:10:52.921808 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/test-admin.keytab.
Aug 12 11:10:52 dist-test-slave-rmhg krb5kdc[13533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:52.951260 4201 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260812 11:10:52.956710 14391 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:52.954108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50308 (local address 127.4.26.65:40127)
0812 11:10:52.954819 (+ 711us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.954827 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.954853 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:10:52.954916 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.954922 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.955148 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.955311 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.956282 (+ 971us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50308: BlockingRecv error: recv got EOF from 127.0.0.1:50308 (error 108)
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":282,"threads_started":1}
W20260812 11:10:52.957194 4201 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/krb5cc' of type FILE
Aug 12 11:10:52 dist-test-slave-rmhg krb5kdc[13533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:52.958962 4201 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 11:10:52 dist-test-slave-rmhg krb5kdc[13533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:52.960438 4201 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 11:10:52 dist-test-slave-rmhg krb5kdc[13533](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:10:52.978685 14391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.962514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50320 (local address 127.4.26.65:40127)
0812 11:10:52.962727 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.962734 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.962934 (+ 200us) server_negotiation.cc:407] Connection header received
0812 11:10:52.963079 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.963083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.963152 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.963240 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.964378 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.965522 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.966882 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.967591 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.967708 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.971919 (+ 4211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.971938 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.971959 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.972018 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:52.975242 (+ 3224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.976193 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.976204 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.976206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.976370 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:52.976853 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:52.976858 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:52.976860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:52.977432 (+ 572us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:52.977693 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:52.978092 (+ 399us) server_negotiation.cc:299] Negotiation successful
0812 11:10:52.978363 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260812 11:10:52.985394 14391 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:52.983260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50336 (local address 127.4.26.65:40127)
0812 11:10:52.983487 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.983493 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.983741 (+ 248us) server_negotiation.cc:407] Connection header received
0812 11:10:52.983916 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.983920 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.983994 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.984084 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.985059 (+ 975us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50336: BlockingRecv error: recv got EOF from 127.0.0.1:50336 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260812 11:10:52.985502 4201 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/krb5cc' of type FILE
Aug 12 11:10:52 dist-test-slave-rmhg krb5kdc[13533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:52.987231 4201 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 11:10:52 dist-test-slave-rmhg krb5kdc[13533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:52.988551 4201 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 11:10:52 dist-test-slave-rmhg krb5kdc[13533](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533052, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:10:53.004317 14391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:52.990184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50338 (local address 127.4.26.65:40127)
0812 11:10:52.990416 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:52.990421 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:52.990613 (+ 192us) server_negotiation.cc:407] Connection header received
0812 11:10:52.990767 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:52.990771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:52.990835 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:52.990911 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:52.991948 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.992723 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.994091 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:52.994554 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:52.994711 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:52.998939 (+ 4228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:52.998945 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:52.998948 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:52.999011 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:53.001787 (+ 2776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:53.002638 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:53.002644 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:53.002646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:53.002798 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:53.003114 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:53.003119 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:53.003122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:53.003411 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:53.003627 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:53.003834 (+ 207us) server_negotiation.cc:299] Negotiation successful
0812 11:10:53.004011 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260812 11:10:53.008975 14391 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:10:53.007270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50340 (local address 127.4.26.65:40127)
0812 11:10:53.007483 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:53.007489 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:53.007739 (+ 250us) server_negotiation.cc:407] Connection header received
0812 11:10:53.007886 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:53.007889 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:53.007961 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:53.008037 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:53.008726 (+ 689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50340: BlockingRecv error: recv got EOF from 127.0.0.1:50340 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260812 11:10:53.009452 4201 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786532997575371-4201-0/krb5kdc/krb5cc' of type FILE
Aug 12 11:10:53 dist-test-slave-rmhg krb5kdc[13533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:53.010963 4201 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 12 11:10:53 dist-test-slave-rmhg krb5kdc[13533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:53.012328 4201 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 12 11:10:53 dist-test-slave-rmhg krb5kdc[13533](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:10:53.027769 14391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:53.013768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50352 (local address 127.4.26.65:40127)
0812 11:10:53.013975 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:53.013981 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:53.014272 (+ 291us) server_negotiation.cc:407] Connection header received
0812 11:10:53.014437 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:53.014441 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:53.014506 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:53.014587 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:53.015641 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.016396 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.017708 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.018133 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.018250 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:53.022113 (+ 3863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:53.022119 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:53.022122 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:53.022162 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:53.024849 (+ 2687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:53.025634 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:53.025639 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:53.025641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:53.025812 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:53.026203 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:53.026208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:53.026210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:53.026542 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:53.026860 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:53.027182 (+ 322us) server_negotiation.cc:299] Negotiation successful
0812 11:10:53.027412 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:10:53.029528 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 13720
I20260812 11:10:53.042888 14391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:53.030280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50364 (local address 127.4.26.65:40127)
0812 11:10:53.030454 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:53.030461 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:53.030790 (+ 329us) server_negotiation.cc:407] Connection header received
0812 11:10:53.030974 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:53.030978 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:53.031044 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:53.031124 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:53.032183 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.032889 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.034206 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.034639 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.034771 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:53.037008 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:53.037013 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:53.037016 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:53.037056 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:53.039872 (+ 2816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:53.040794 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:53.040799 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:53.040801 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:53.040941 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:53.041377 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:53.041380 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:53.041383 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:53.041708 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:53.041992 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:53.042346 (+ 354us) server_negotiation.cc:299] Negotiation successful
0812 11:10:53.042572 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:10:53.043490 13914 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:53.129398 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 13720
I20260812 11:10:53.152908 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 13940
Aug 12 11:10:53 dist-test-slave-rmhg krb5kdc[13533](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:10:53.169581 14413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:53.153916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34986 (local address 127.4.26.66:37587)
0812 11:10:53.154495 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:53.154502 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:53.154531 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:10:53.154596 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:53.154603 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:53.154828 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:53.154972 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:53.156088 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.157265 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.158629 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.159216 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.159338 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:53.163447 (+ 4109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:53.163463 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:53.163482 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:53.163532 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:53.166589 (+ 3057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:53.167462 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:53.167471 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:53.167473 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:53.167625 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:53.167963 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:53.167966 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:53.167968 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:53.168357 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:53.168603 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:53.168983 (+ 380us) server_negotiation.cc:299] Negotiation successful
0812 11:10:53.169282 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":306,"threads_started":1}
I20260812 11:10:53.170890 14158 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:53.254227 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 13940
I20260812 11:10:53.277130 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 14177
Aug 12 11:10:53 dist-test-slave-rmhg krb5kdc[13533](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:10:53.295387 14417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:53.278242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39328 (local address 127.4.26.67:36435)
0812 11:10:53.278901 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:53.278909 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:53.278940 (+ 31us) server_negotiation.cc:407] Connection header received
0812 11:10:53.279006 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:53.279013 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:53.279237 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:53.279379 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:53.280630 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.281872 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.283341 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:53.284042 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:53.284164 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:53.288745 (+ 4581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:53.288764 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:53.288784 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:53.288833 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:53.292054 (+ 3221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:53.293019 (+ 965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:53.293028 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:53.293030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:53.293233 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:53.293742 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:53.293746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:53.293748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:53.294157 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:53.294460 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:53.294853 (+ 393us) server_negotiation.cc:299] Negotiation successful
0812 11:10:53.295087 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":307,"threads_started":1}
I20260812 11:10:53.296795 14371 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:53.381624 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 14177
I20260812 11:10:53.404006 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 13556
I20260812 11:10:53.405323 13674 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:53.510269 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 13556
2026-08-12T11:10:53Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4369 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:10:53 dist-test-slave-rmhg krb5kdc[14425](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:10:53 dist-test-slave-rmhg krb5kdc[14425](info): set up 2 sockets
Aug 12 11:10:53 dist-test-slave-rmhg krb5kdc[14425](info): commencing operation
krb5kdc: starting...
W20260812 11:10:54.768553 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.000s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:10:54 dist-test-slave-rmhg krb5kdc[14425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:10:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:10:54Z Disabled control of system clock
WARNING: no policy specified for oryx/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.126.keytab.
Entry for principal oryx/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.126.keytab.
I20260812 11:10:55.027348 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:38963
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.126.keytab
--principal=oryx/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:38963
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:55.385375 14451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:55.385721 14451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:55.385860 14451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:55.393462 14451 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:55.393603 14451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:55.393672 14451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:55.393755 14451 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:55.393816 14451 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:55.404286 14451 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:38963
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.126.keytab
--principal=oryx/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:38963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:55.405869 14451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:55.407249 14451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:55.420125 14463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:55.420163 14466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:55.420219 14461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:55.420884 14451 server_base.cc:1034] running on GCE node
I20260812 11:10:55.421814 14451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:55.423388 14451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:55.424631 14451 hybrid_clock.cc:648] HybridClock initialized: now 1786533055424566 us; error 58 us; skew 500 ppm
I20260812 11:10:55.425005 14451 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:55 dist-test-slave-rmhg krb5kdc[14425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533055, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:55.428288 14451 init.cc:377] Logged in from keytab as oryx/127.4.26.126@KRBTEST.COM (short username oryx)
I20260812 11:10:55.429920 14451 webserver.cc:460] Webserver started at http://127.4.26.126:36859/ using document root <none> and password file <none>
I20260812 11:10:55.430661 14451 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:55.430778 14451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:55.431073 14451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:55.434358 14451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "fe3328dc118a4cae86180c14ef0d4d64"
format_stamp: "Formatted at 2026-08-12 11:10:55 on dist-test-slave-rmhg"
server_key: "ce37fab3e892cbfb8a5186706dbfa255"
server_key_iv: "f31280a1c699c99938b4f44afa620136"
server_key_version: "encryptionkey@0"
I20260812 11:10:55.435169 14451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "fe3328dc118a4cae86180c14ef0d4d64"
format_stamp: "Formatted at 2026-08-12 11:10:55 on dist-test-slave-rmhg"
server_key: "ce37fab3e892cbfb8a5186706dbfa255"
server_key_iv: "f31280a1c699c99938b4f44afa620136"
server_key_version: "encryptionkey@0"
I20260812 11:10:55.440722 14451 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:10:55.444533 14481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:55.446178 14451 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:55.446367 14451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "fe3328dc118a4cae86180c14ef0d4d64"
format_stamp: "Formatted at 2026-08-12 11:10:55 on dist-test-slave-rmhg"
server_key: "ce37fab3e892cbfb8a5186706dbfa255"
server_key_iv: "f31280a1c699c99938b4f44afa620136"
server_key_version: "encryptionkey@0"
I20260812 11:10:55.446587 14451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:55.469976 14451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:55.474835 14451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:55.475165 14451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:55.493988 14451 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:38963
I20260812 11:10:55.494014 14555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:38963 every 8 connection(s)
I20260812 11:10:55.495496 14451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:10:55.496131 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 14451
I20260812 11:10:55.496327 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:10:55.497140 4201 external_mini_cluster.cc:1428] Setting key e41dd099c2b8e1d1a07bac5a4795887f
I20260812 11:10:55.500185 14557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 11:10:55 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM
I20260812 11:10:55.514369 14557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64: Bootstrap starting.
I20260812 11:10:55.517926 14557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:55.519372 14557 log.cc:824] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:55.522426 14560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:55.499344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41440 (local address 127.4.26.126:38963)
0812 11:10:55.500148 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:55.500161 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:55.500208 (+ 47us) server_negotiation.cc:407] Connection header received
0812 11:10:55.501945 (+ 1737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:55.501973 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:55.502401 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:55.502762 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:55.504695 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.506430 (+ 1735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.508269 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:55.509017 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:55.509223 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:55.514391 (+ 5168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:55.514400 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:55.514421 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:55.514476 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:55.517699 (+ 3223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.518689 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.518697 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.518704 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.518895 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:55.519349 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:55.519352 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:55.519358 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:55.520086 (+ 728us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:55.520428 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:55.520834 (+ 406us) server_negotiation.cc:299] Negotiation successful
0812 11:10:55.521341 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":340,"threads_started":1}
I20260812 11:10:55.522814 14557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64: No bootstrap required, opened a new log
I20260812 11:10:55.531818 14557 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } }
I20260812 11:10:55.532291 14557 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:55.532406 14557 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe3328dc118a4cae86180c14ef0d4d64, State: Initialized, Role: FOLLOWER
I20260812 11:10:55.533037 14557 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } }
I20260812 11:10:55.533365 14557 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:10:55.533516 14557 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:10:55.533687 14557 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:55.536123 14557 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } }
I20260812 11:10:55.536743 14557 leader_election.cc:302] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe3328dc118a4cae86180c14ef0d4d64; no voters:
I20260812 11:10:55.537421 14557 leader_election.cc:288] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:10:55.537567 14564 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:10:55.538261 14564 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [term 1 LEADER]: Becoming Leader. State: Replica: fe3328dc118a4cae86180c14ef0d4d64, State: Running, Role: LEADER
I20260812 11:10:55.538866 14564 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } }
I20260812 11:10:55.539697 14557 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:55.541661 14565 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } }
I20260812 11:10:55.541760 14566 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe3328dc118a4cae86180c14ef0d4d64. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } }
I20260812 11:10:55.542076 14565 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:55.542076 14566 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:55.543221 14576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:10:55.550787 14576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:10:55.561246 14576 catalog_manager.cc:1347] Generated new cluster ID: e5eabb831a3749488b23faef0c1c0891
I20260812 11:10:55.561379 14576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:10:55.576958 14576 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:10:55.579034 14576 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:10:55.591539 14576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64: Generated new TSK 0
I20260812 11:10:55.592886 14576 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.65.keytab.
Entry for principal oryx/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.65.keytab.
I20260812 11:10:55.648808 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:38963
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.65.keytab
--principal=oryx/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:55.998126 14600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:55.998430 14600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:55.998550 14600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:56.006138 14600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:56.006278 14600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:56.006430 14600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:10:56.016914 14600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.65.keytab
--principal=oryx/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:38963
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:56.018399 14600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:56.019873 14600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:56.034806 14612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:56.034852 14608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:56.034832 14610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:56.035615 14600 server_base.cc:1034] running on GCE node
I20260812 11:10:56.036285 14600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:56.037354 14600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:56.038570 14600 hybrid_clock.cc:648] HybridClock initialized: now 1786533056038512 us; error 53 us; skew 500 ppm
I20260812 11:10:56.038913 14600 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:56 dist-test-slave-rmhg krb5kdc[14425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533056, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:56.042490 14600 init.cc:377] Logged in from keytab as oryx/127.4.26.65@KRBTEST.COM (short username oryx)
I20260812 11:10:56.044238 14600 webserver.cc:460] Webserver started at http://127.4.26.65:41605/ using document root <none> and password file <none>
I20260812 11:10:56.045029 14600 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:56.045204 14600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:56.045565 14600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:56.048771 14600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "50c81efc0e36481abeda1faaad9fc87d"
format_stamp: "Formatted at 2026-08-12 11:10:56 on dist-test-slave-rmhg"
server_key: "e16ec56089a828ef1fa47304f5baddfa"
server_key_iv: "12c7ff349569140e72fe95d948987dd7"
server_key_version: "encryptionkey@0"
I20260812 11:10:56.049707 14600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "50c81efc0e36481abeda1faaad9fc87d"
format_stamp: "Formatted at 2026-08-12 11:10:56 on dist-test-slave-rmhg"
server_key: "e16ec56089a828ef1fa47304f5baddfa"
server_key_iv: "12c7ff349569140e72fe95d948987dd7"
server_key_version: "encryptionkey@0"
I20260812 11:10:56.055410 14600 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:10:56.059218 14623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:56.060799 14600 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:10:56.060998 14600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "50c81efc0e36481abeda1faaad9fc87d"
format_stamp: "Formatted at 2026-08-12 11:10:56 on dist-test-slave-rmhg"
server_key: "e16ec56089a828ef1fa47304f5baddfa"
server_key_iv: "12c7ff349569140e72fe95d948987dd7"
server_key_version: "encryptionkey@0"
I20260812 11:10:56.061259 14600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:56.086731 14600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:56.091435 14600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:56.091749 14600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:56.092758 14600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:56.094275 14600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:56.094358 14600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:56.094484 14600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:56.094551 14600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:56.125937 14600 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:37083
I20260812 11:10:56.126019 14819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:37083 every 8 connection(s)
I20260812 11:10:56.127267 14600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:56.134361 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 14600
I20260812 11:10:56.134593 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:10:56.135419 4201 external_mini_cluster.cc:1428] Setting key cb44ef4aa38202c5358e592edf90f7d0
Aug 12 11:10:56 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533056, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM
I20260812 11:10:56.149019 14824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:56.129809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:53811 (local address 127.4.26.126:38963)
0812 11:10:56.130261 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:56.130266 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:56.131202 (+ 936us) server_negotiation.cc:407] Connection header received
0812 11:10:56.133103 (+ 1901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:56.133109 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:56.133230 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:56.133330 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:56.135390 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.136182 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.138220 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.138623 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.138726 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:56.142914 (+ 4188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:56.142923 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:56.142926 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:56.143008 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:56.145730 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:56.146597 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:56.146602 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:56.146604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:56.146733 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:56.147213 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:56.147217 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:56.147220 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:56.147512 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:56.147651 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:56.148413 (+ 762us) server_negotiation.cc:299] Negotiation successful
0812 11:10:56.148659 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":240,"threads_started":1}
I20260812 11:10:56.150144 14825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:56.130304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.65:53811)
0812 11:10:56.131019 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:56.131072 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:56.132800 (+ 1728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:56.133600 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:56.133608 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:56.134307 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:56.135178 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:56.135205 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.136348 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.136353 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:56.138065 (+ 1712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:56.138081 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.138857 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.138862 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:56.139171 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:56.139888 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:56.139919 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:56.142601 (+ 2682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:56.145893 (+ 3292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:56.145904 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:56.145926 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:56.146465 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:56.146849 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:56.146854 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:56.146857 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:56.147100 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:56.147656 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:56.147665 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:56.148029 (+ 364us) client_negotiation.cc:769] Sending connection context
0812 11:10:56.148291 (+ 262us) client_negotiation.cc:240] Negotiation successful
0812 11:10:56.148880 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":268,"threads_started":1}
I20260812 11:10:56.151964 14821 heartbeater.cc:347] Connected to a master server at 127.4.26.126:38963
I20260812 11:10:56.152282 14821 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:56.153057 14821 heartbeater.cc:511] Master 127.4.26.126:38963 requested a full tablet report, sending...
I20260812 11:10:56.155567 14509 ts_manager.cc:194] Registered new tserver with Master: 50c81efc0e36481abeda1faaad9fc87d (127.4.26.65:37083)
I20260812 11:10:56.157788 14509 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:53811
WARNING: no policy specified for oryx/127.4.26.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.26.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.66.keytab.
Entry for principal oryx/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.66.keytab.
I20260812 11:10:56.192499 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:38963
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.66.keytab
--principal=oryx/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:56.553939 14833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:56.554253 14833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:56.554355 14833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:56.562086 14833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:56.562222 14833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:56.562337 14833 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:10:56.572702 14833 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.66.keytab
--principal=oryx/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:38963
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:56.574120 14833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:56.575486 14833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:56.589897 14845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:56.589969 14842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:56.589936 14853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:56.590826 14833 server_base.cc:1034] running on GCE node
I20260812 11:10:56.591511 14833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:56.592646 14833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:56.593853 14833 hybrid_clock.cc:648] HybridClock initialized: now 1786533056593801 us; error 48 us; skew 500 ppm
I20260812 11:10:56.594208 14833 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:56 dist-test-slave-rmhg krb5kdc[14425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533056, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:56.597518 14833 init.cc:377] Logged in from keytab as oryx/127.4.26.66@KRBTEST.COM (short username oryx)
I20260812 11:10:56.598981 14833 webserver.cc:460] Webserver started at http://127.4.26.66:36497/ using document root <none> and password file <none>
I20260812 11:10:56.599677 14833 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:56.599783 14833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:56.600044 14833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:56.603128 14833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "e4167a41432a476688a1acac83242072"
format_stamp: "Formatted at 2026-08-12 11:10:56 on dist-test-slave-rmhg"
server_key: "38bbb0bc3e299527331716d833539c17"
server_key_iv: "d7548324bcdb6f2e020862a604582db0"
server_key_version: "encryptionkey@0"
I20260812 11:10:56.603865 14833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "e4167a41432a476688a1acac83242072"
format_stamp: "Formatted at 2026-08-12 11:10:56 on dist-test-slave-rmhg"
server_key: "38bbb0bc3e299527331716d833539c17"
server_key_iv: "d7548324bcdb6f2e020862a604582db0"
server_key_version: "encryptionkey@0"
I20260812 11:10:56.609416 14833 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:10:56.613091 14860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:56.614632 14833 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:56.614787 14833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "e4167a41432a476688a1acac83242072"
format_stamp: "Formatted at 2026-08-12 11:10:56 on dist-test-slave-rmhg"
server_key: "38bbb0bc3e299527331716d833539c17"
server_key_iv: "d7548324bcdb6f2e020862a604582db0"
server_key_version: "encryptionkey@0"
I20260812 11:10:56.614972 14833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:56.631155 14833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:56.635519 14833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:56.635802 14833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:56.636777 14833 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:56.638245 14833 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:56.638324 14833 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:56.638409 14833 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:56.638456 14833 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:56.670538 14833 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:40653
I20260812 11:10:56.670578 15048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:40653 every 8 connection(s)
I20260812 11:10:56.671862 14833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:10:56.678449 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 14833
I20260812 11:10:56.678609 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:10:56.679077 4201 external_mini_cluster.cc:1428] Setting key 12919a961403bf0d193d3cf21979b63d
Aug 12 11:10:56 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533056, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM
I20260812 11:10:56.692920 15055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:56.674612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:39833 (local address 127.4.26.126:38963)
0812 11:10:56.675115 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:56.675120 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:56.676054 (+ 934us) server_negotiation.cc:407] Connection header received
0812 11:10:56.678040 (+ 1986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:56.678046 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:56.678136 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:56.678235 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:56.679975 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.681046 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.682760 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.683206 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.683321 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:56.686779 (+ 3458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:56.686784 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:56.686788 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:56.686819 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:56.689855 (+ 3036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:56.690589 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:56.690595 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:56.690598 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:56.690763 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:56.691173 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:56.691177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:56.691180 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:56.691502 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:56.691664 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:56.692325 (+ 661us) server_negotiation.cc:299] Negotiation successful
0812 11:10:56.692541 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":264,"threads_started":1}
I20260812 11:10:56.693766 15057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:56.675058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.66:39833)
0812 11:10:56.675867 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:56.675908 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:56.677733 (+ 1825us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:56.678508 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:56.678517 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:56.679100 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:56.679743 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:56.679764 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.681255 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.681260 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:56.682609 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:56.682623 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:56.683452 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:56.683460 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:56.683708 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:56.684344 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:56.684368 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:56.686554 (+ 2186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:56.690017 (+ 3463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:56.690024 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:56.690037 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:56.690453 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:56.690855 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:56.690858 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:56.690860 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:56.691062 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:56.691612 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:56.691618 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:56.691945 (+ 327us) client_negotiation.cc:769] Sending connection context
0812 11:10:56.692197 (+ 252us) client_negotiation.cc:240] Negotiation successful
0812 11:10:56.692599 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":327,"threads_started":1}
I20260812 11:10:56.695291 15051 heartbeater.cc:347] Connected to a master server at 127.4.26.126:38963
I20260812 11:10:56.695724 15051 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:56.696645 15051 heartbeater.cc:511] Master 127.4.26.126:38963 requested a full tablet report, sending...
I20260812 11:10:56.698522 14509 ts_manager.cc:194] Registered new tserver with Master: e4167a41432a476688a1acac83242072 (127.4.26.66:40653)
I20260812 11:10:56.699440 14509 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:39833
WARNING: no policy specified for oryx/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.67.keytab.
Entry for principal oryx/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.67.keytab.
I20260812 11:10:56.736294 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:38963
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.67.keytab
--principal=oryx/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:57.082487 15061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:57.082844 15061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:57.082975 15061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:57.090576 15061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:57.090734 15061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:57.090899 15061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:10:57.101253 15061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.67.keytab
--principal=oryx/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:38963
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:57.102720 15061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:57.104120 15061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:57.117857 15070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:57.117900 15072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:57.117816 15067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:57.118976 15061 server_base.cc:1034] running on GCE node
I20260812 11:10:57.119644 15061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:57.120728 15061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:57.121953 15061 hybrid_clock.cc:648] HybridClock initialized: now 1786533057121886 us; error 49 us; skew 500 ppm
I20260812 11:10:57.122334 15061 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:57 dist-test-slave-rmhg krb5kdc[14425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533057, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:57.125820 15061 init.cc:377] Logged in from keytab as oryx/127.4.26.67@KRBTEST.COM (short username oryx)
I20260812 11:10:57.127722 15061 webserver.cc:460] Webserver started at http://127.4.26.67:42591/ using document root <none> and password file <none>
I20260812 11:10:57.128682 15061 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:57.128835 15061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:57.129240 15061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:57.133059 15061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "ab1fd6437c64499fb788884c45137d6f"
format_stamp: "Formatted at 2026-08-12 11:10:57 on dist-test-slave-rmhg"
server_key: "85a8e5505bc31deac6dcbc4a60d4f4f6"
server_key_iv: "d50a3ebe1625133567562c0423cc0a81"
server_key_version: "encryptionkey@0"
I20260812 11:10:57.133924 15061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "ab1fd6437c64499fb788884c45137d6f"
format_stamp: "Formatted at 2026-08-12 11:10:57 on dist-test-slave-rmhg"
server_key: "85a8e5505bc31deac6dcbc4a60d4f4f6"
server_key_iv: "d50a3ebe1625133567562c0423cc0a81"
server_key_version: "encryptionkey@0"
I20260812 11:10:57.139447 15061 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:10:57.143255 15079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:57.144886 15061 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:10:57.145064 15061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "ab1fd6437c64499fb788884c45137d6f"
format_stamp: "Formatted at 2026-08-12 11:10:57 on dist-test-slave-rmhg"
server_key: "85a8e5505bc31deac6dcbc4a60d4f4f6"
server_key_iv: "d50a3ebe1625133567562c0423cc0a81"
server_key_version: "encryptionkey@0"
I20260812 11:10:57.145323 15061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:57.161257 14821 heartbeater.cc:503] Master 127.4.26.126:38963 was elected leader, sending a full tablet report...
I20260812 11:10:57.184070 15061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:57.188385 15061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:57.188690 15061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:57.189780 15061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:57.191177 15061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:57.191252 15061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:57.191375 15061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:57.191425 15061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:57.223127 15061 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:45777
I20260812 11:10:57.223204 15256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:45777 every 8 connection(s)
I20260812 11:10:57.224498 15061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:10:57.233080 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 15061
I20260812 11:10:57.233273 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:10:57.233737 4201 external_mini_cluster.cc:1428] Setting key af82cf7a71e937c0ecf696604afededc
Aug 12 11:10:57 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533057, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM
I20260812 11:10:57.247160 15260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:57.227193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:39353 (local address 127.4.26.126:38963)
0812 11:10:57.227676 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:57.227681 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:57.228553 (+ 872us) server_negotiation.cc:407] Connection header received
0812 11:10:57.230557 (+ 2004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:57.230563 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:57.230680 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:57.230784 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:57.232787 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.233825 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.235801 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.236369 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.236497 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:57.240527 (+ 4030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:57.240534 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:57.240537 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:57.240578 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:57.243549 (+ 2971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:57.244467 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:57.244473 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:57.244475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:57.244627 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:57.245128 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:57.245132 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:57.245135 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:57.245488 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:57.245649 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:57.246477 (+ 828us) server_negotiation.cc:299] Negotiation successful
0812 11:10:57.246742 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":235,"threads_started":1}
I20260812 11:10:57.248490 15261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:57.227609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.67:39353)
0812 11:10:57.228365 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:57.228415 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:57.230218 (+ 1803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:57.231148 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:57.231162 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:57.231793 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:57.232506 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:57.232543 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.234041 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.234047 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:57.235586 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:57.235606 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.236630 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.236638 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:57.236972 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:57.237721 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:57.237747 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:57.240228 (+ 2481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:57.243749 (+ 3521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:57.243761 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:57.243782 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:57.244307 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:57.244757 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:57.244763 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:57.244765 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:57.244994 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:57.245657 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:57.245667 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:57.246059 (+ 392us) client_negotiation.cc:769] Sending connection context
0812 11:10:57.246346 (+ 287us) client_negotiation.cc:240] Negotiation successful
0812 11:10:57.246978 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":287,"threads_started":1}
I20260812 11:10:57.250291 15258 heartbeater.cc:347] Connected to a master server at 127.4.26.126:38963
I20260812 11:10:57.250629 15258 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:57.251420 15258 heartbeater.cc:511] Master 127.4.26.126:38963 requested a full tablet report, sending...
I20260812 11:10:57.252952 14509 ts_manager.cc:194] Registered new tserver with Master: ab1fd6437c64499fb788884c45137d6f (127.4.26.67:45777)
I20260812 11:10:57.253796 14509 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:39353
I20260812 11:10:57.263278 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.4.26.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.26.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.26.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.125.keytab.
Entry for principal oryx/127.4.26.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.125.keytab.
I20260812 11:10:57.318543 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.125:33193
--webserver_interface=127.4.26.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.125.keytab
--principal=oryx/127.4.26.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:38963,127.4.26.125:33193
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:10:57.666205 15267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:57.666564 15267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:57.666712 15267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:57.674366 15267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:57.674481 15267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:57.674542 15267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:57.674625 15267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:57.674685 15267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:57.685281 15267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:38963,127.4.26.125:33193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.125.keytab
--principal=oryx/127.4.26.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.125:33193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.26.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
W20260812 11:10:57.685698 15267 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.4.26.126:38963,127.4.26.125:33193'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260812 11:10:57.686797 15267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:57.688182 15267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:57.700670 15276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:57.700500 15274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:57.701083 15273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:57.701344 15267 server_base.cc:1034] running on GCE node
I20260812 11:10:57.702155 15267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:57.702800 15051 heartbeater.cc:503] Master 127.4.26.126:38963 was elected leader, sending a full tablet report...
I20260812 11:10:57.703908 15267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:57.705181 15267 hybrid_clock.cc:648] HybridClock initialized: now 1786533057705085 us; error 57 us; skew 500 ppm
I20260812 11:10:57.705544 15267 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:57 dist-test-slave-rmhg krb5kdc[14425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533057, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:57.712704 15267 init.cc:377] Logged in from keytab as oryx/127.4.26.125@KRBTEST.COM (short username oryx)
I20260812 11:10:57.714569 15267 webserver.cc:460] Webserver started at http://127.4.26.125:32779/ using document root <none> and password file <none>
I20260812 11:10:57.715384 15267 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:57.715490 15267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:57.715809 15267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:57.719172 15267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/data/instance:
uuid: "3507be9fe2f4400999bd423b26580f0c"
format_stamp: "Formatted at 2026-08-12 11:10:57 on dist-test-slave-rmhg"
server_key: "561d0b9bab14ddacfc99b00c551ef649"
server_key_iv: "e89b60f8668187195d0fb314aa51a874"
server_key_version: "encryptionkey@0"
I20260812 11:10:57.720031 15267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/wal/instance:
uuid: "3507be9fe2f4400999bd423b26580f0c"
format_stamp: "Formatted at 2026-08-12 11:10:57 on dist-test-slave-rmhg"
server_key: "561d0b9bab14ddacfc99b00c551ef649"
server_key_iv: "e89b60f8668187195d0fb314aa51a874"
server_key_version: "encryptionkey@0"
I20260812 11:10:57.725955 15267 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260812 11:10:57.729939 15292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:57.731571 15267 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:10:57.731761 15267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/wal
uuid: "3507be9fe2f4400999bd423b26580f0c"
format_stamp: "Formatted at 2026-08-12 11:10:57 on dist-test-slave-rmhg"
server_key: "561d0b9bab14ddacfc99b00c551ef649"
server_key_iv: "e89b60f8668187195d0fb314aa51a874"
server_key_version: "encryptionkey@0"
I20260812 11:10:57.731983 15267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:57.752861 15267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:57.757109 15267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:57.757422 15267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:57.775673 15267 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.125:33193
I20260812 11:10:57.775683 15381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.125:33193 every 8 connection(s)
I20260812 11:10:57.777184 15267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/data/info.pb
I20260812 11:10:57.781466 15382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:57.783370 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 15267
I20260812 11:10:57.791940 15382 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:10:57 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.26.125@KRBTEST.COM
Aug 12 11:10:57 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533057, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.125@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM
I20260812 11:10:57.809441 15386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:57.785966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53504 (local address 127.4.26.125:33193)
0812 11:10:57.786856 (+ 890us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:57.786870 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:57.786918 (+ 48us) server_negotiation.cc:407] Connection header received
0812 11:10:57.788553 (+ 1635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:57.788581 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:57.789055 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:57.789477 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:57.791353 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.792749 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.794121 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.794924 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.795707 (+ 783us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:57.800170 (+ 4463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:57.800180 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:57.800195 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:57.800241 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:57.804115 (+ 3874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:57.805216 (+ 1101us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:57.805224 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:57.805232 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:57.805396 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:57.805866 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:57.805871 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:57.805874 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:57.806751 (+ 877us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:57.807074 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:57.807525 (+ 451us) server_negotiation.cc:299] Negotiation successful
0812 11:10:57.808034 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":664,"thread_start_us":406,"threads_started":1}
I20260812 11:10:57.811178 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:57.794709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41444 (local address 127.4.26.126:38963)
0812 11:10:57.795218 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:57.795224 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:57.795898 (+ 674us) server_negotiation.cc:407] Connection header received
0812 11:10:57.795974 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:57.795980 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:57.796074 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:57.796197 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:57.797329 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.798427 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.800131 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.800577 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.800695 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:57.804662 (+ 3967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:57.804671 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:57.804676 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:57.804732 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:57.808113 (+ 3381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:57.808911 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:57.808918 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:57.808921 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:57.809080 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:57.809470 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:57.809475 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:57.809478 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:57.809952 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:57.810094 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:57.810582 (+ 488us) server_negotiation.cc:299] Negotiation successful
0812 11:10:57.810828 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":248,"threads_started":1}
I20260812 11:10:57.811309 15389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:57.794705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:41444)
0812 11:10:57.795584 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:57.795654 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:57.795833 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:57.796265 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:57.796270 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:57.796885 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:57.797127 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:57.797137 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.798606 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.798611 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:57.799930 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:57.799948 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.800790 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.800797 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:57.800985 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:57.801509 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:57.801535 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:57.804360 (+ 2825us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:57.808280 (+ 3920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:57.808292 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:57.808298 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:57.808774 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:57.809219 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:57.809223 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:57.809225 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:57.809358 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:57.810091 (+ 733us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:57.810100 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:57.810282 (+ 182us) client_negotiation.cc:769] Sending connection context
0812 11:10:57.810465 (+ 183us) client_negotiation.cc:240] Negotiation successful
0812 11:10:57.810820 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":485,"threads_started":1}
I20260812 11:10:57.813357 15382 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:10:57 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533057, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.125@KRBTEST.COM for oryx/127.4.26.125@KRBTEST.COM
I20260812 11:10:57.830978 15389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:57.814056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:33193 (local address 127.0.0.1:53508)
0812 11:10:57.814298 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:57.814319 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:57.814440 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:57.814706 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:57.814710 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:57.815089 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:57.815224 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:57.815232 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.816391 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.816397 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:57.817714 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:57.817734 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.818884 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.818893 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:57.819235 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:57.820045 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:57.820070 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:57.822557 (+ 2487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:57.828495 (+ 5938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:57.828502 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:57.828506 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:57.829030 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:57.829448 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:57.829451 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:57.829454 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:57.829594 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:57.830183 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:57.830186 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:57.830328 (+ 142us) client_negotiation.cc:769] Sending connection context
0812 11:10:57.830440 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 11:10:57.830721 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"mutex_wait_us":60}
I20260812 11:10:57.831220 15386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:57.814169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53508 (local address 127.4.26.125:33193)
0812 11:10:57.814321 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:57.814327 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:57.814386 (+ 59us) server_negotiation.cc:407] Connection header received
0812 11:10:57.814539 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:57.814544 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:57.814597 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:57.814674 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:57.815353 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.816209 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.817952 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.818653 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.818894 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:57.822773 (+ 3879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:57.822778 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:57.822782 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:57.822814 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:57.828297 (+ 5483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:57.829205 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:57.829211 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:57.829215 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:57.829345 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:57.829738 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:57.829742 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:57.829744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:57.830063 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:57.830197 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:57.830520 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 11:10:57.830848 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":145,"server-negotiator.queue_time_us":63}
I20260812 11:10:57.836030 15382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: Bootstrap starting.
I20260812 11:10:57.839260 15382 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:57.840363 15382 log.cc:824] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:57.843134 15382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: No bootstrap required, opened a new log
I20260812 11:10:57.850271 15382 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } }
I20260812 11:10:57.850589 15382 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:57.850697 15382 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3507be9fe2f4400999bd423b26580f0c, State: Initialized, Role: FOLLOWER
I20260812 11:10:57.851285 15382 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } }
I20260812 11:10:57.852164 15391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } } }
I20260812 11:10:57.852464 15391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:10:57.853113 15382 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: configured and running, proceeding with master startup.
W20260812 11:10:57.862522 15409 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:10:57.862690 15409 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:10:57.866451 15267 master_runner.cc:428] Detected that this master 3507be9fe2f4400999bd423b26580f0c is joining an existing cluster
I20260812 11:10:57.866569 15267 master_runner.cc:432] Initiating AddMaster RPC to add 127.4.26.125:33193
I20260812 11:10:57.869539 15391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:10:57.869837 15391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } }
I20260812 11:10:57.871309 15391 leader_election.cc:288] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe3328dc118a4cae86180c14ef0d4d64 (127.4.26.126:38963)
I20260812 11:10:57.872177 14524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3507be9fe2f4400999bd423b26580f0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe3328dc118a4cae86180c14ef0d4d64" is_pre_election: true
I20260812 11:10:57.873562 15294 leader_election.cc:302] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 3507be9fe2f4400999bd423b26580f0c; no voters: fe3328dc118a4cae86180c14ef0d4d64
I20260812 11:10:57.874257 15391 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 11:10:57.891702 15386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:57.876361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53522 (local address 127.4.26.125:33193)
0812 11:10:57.876612 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:57.876621 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:57.877344 (+ 723us) server_negotiation.cc:407] Connection header received
0812 11:10:57.877554 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:57.877558 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:57.877632 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:57.877702 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:57.879093 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.880193 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.882094 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.882707 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.882798 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:57.885322 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:57.885329 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:57.885334 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:57.885374 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:57.888711 (+ 3337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:57.889499 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:57.889513 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:57.889517 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:57.889684 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:57.890102 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:57.890106 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:57.890109 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:57.890489 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:57.890637 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:57.891092 (+ 455us) server_negotiation.cc:299] Negotiation successful
0812 11:10:57.891324 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260812 11:10:57.892338 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:57.875347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41458 (local address 127.4.26.126:38963)
0812 11:10:57.875539 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:57.875545 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:57.875833 (+ 288us) server_negotiation.cc:407] Connection header received
0812 11:10:57.876097 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:57.876111 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:57.876212 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:57.876326 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:57.878224 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.879382 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.881552 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.882258 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.882368 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:57.885456 (+ 3088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:57.885464 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:57.885468 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:57.885512 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:57.889092 (+ 3580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:57.889939 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:57.889945 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:57.889949 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:57.890124 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:57.890593 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:57.890599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:57.890602 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:57.890996 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:57.891147 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:57.891740 (+ 593us) server_negotiation.cc:299] Negotiation successful
0812 11:10:57.892001 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:10:57.893391 15418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:57.876439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:33193 (local address 127.0.0.1:53522)
0812 11:10:57.877240 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:57.877261 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:57.877432 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:57.877897 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:57.877901 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:57.878616 (+ 715us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:57.878945 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:57.878957 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.880413 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.880417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:57.881960 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:57.881974 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.883081 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.883087 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:57.883266 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:57.883882 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:57.883904 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:57.885092 (+ 1188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:57.888845 (+ 3753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:57.888849 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:57.888852 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:57.889393 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:57.889828 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:57.889832 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:57.889835 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:57.890002 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:57.890697 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:57.890701 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:57.890838 (+ 137us) client_negotiation.cc:769] Sending connection context
0812 11:10:57.892253 (+ 1415us) client_negotiation.cc:240] Negotiation successful
0812 11:10:57.892831 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":407,"threads_started":1}
I20260812 11:10:57.893560 15416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:57.874931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:41458)
0812 11:10:57.875709 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:57.875729 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:57.875951 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:57.876703 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:57.876708 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:57.877518 (+ 810us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:57.877998 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:57.878013 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.879575 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.879580 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:57.881362 (+ 1782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:57.881378 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.882743 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.882751 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:57.882943 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:57.883762 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:57.883787 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:57.885224 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:57.889308 (+ 4084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:57.889313 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:57.889317 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:57.889783 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:57.890283 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:57.890288 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:57.890291 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:57.890456 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:57.891230 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:57.891235 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:57.891442 (+ 207us) client_negotiation.cc:769] Sending connection context
0812 11:10:57.892592 (+ 1150us) client_negotiation.cc:240] Negotiation successful
0812 11:10:57.893016 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"mutex_wait_us":65,"thread_start_us":615,"threads_started":1}
WARNING: no policy specified for oryx/127.4.26.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.26.124@KRBTEST.COM" created.
Aug 12 11:10:57 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533055, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.126@KRBTEST.COM for oryx/127.4.26.125@KRBTEST.COM
I20260812 11:10:57.918605 15422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:57.901347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:33193 (local address 127.0.0.1:53534)
0812 11:10:57.901957 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:57.901996 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:57.902174 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:57.902915 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:57.902923 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:57.903614 (+ 691us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:57.903846 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:57.903860 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.904976 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.904981 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:57.906104 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:57.906118 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.906897 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.906904 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:57.907111 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:57.907748 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:57.907772 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:57.910235 (+ 2463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:57.914910 (+ 4675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:57.914931 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:57.914941 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:57.915650 (+ 709us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:57.916184 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:57.916190 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:57.916194 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:57.916401 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:57.917243 (+ 842us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:57.917253 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:57.917496 (+ 243us) client_negotiation.cc:769] Sending connection context
0812 11:10:57.917724 (+ 228us) client_negotiation.cc:240] Negotiation successful
0812 11:10:57.918141 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":243,"threads_started":1}
I20260812 11:10:57.918699 15386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:57.902393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53534 (local address 127.4.26.125:33193)
0812 11:10:57.902545 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:57.902549 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:57.902564 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:10:57.902653 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:57.902657 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:57.902734 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:57.902821 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:57.904070 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.904840 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.906249 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.906732 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.906843 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:57.910474 (+ 3631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:57.910482 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:57.910488 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:57.910536 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:57.914644 (+ 4108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:57.915833 (+ 1189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:57.915839 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:57.915842 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:57.916046 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:57.916570 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:57.916576 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:57.916579 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:57.917056 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:57.917235 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:57.917862 (+ 627us) server_negotiation.cc:299] Negotiation successful
0812 11:10:57.918335 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260812 11:10:57.921343 14509 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.4.26.125:33193: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3507be9fe2f4400999bd423b26580f0c"
member_type: NON_VOTER
last_known_addr {
host: "127.4.26.125"
port: 33193
}
attrs {
promote: true
}
}
dest_uuid: "fe3328dc118a4cae86180c14ef0d4d64"
cas_config_opid_index: -1
I20260812 11:10:57.923085 14509 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } }
I20260812 11:10:57.928064 15341 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:57.927156 15428 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3507be9fe2f4400999bd423b26580f0c (127.4.26.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } } }
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.26.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.124.keytab.
Entry for principal oryx/127.4.26.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.124.keytab.
I20260812 11:10:57.932338 15341 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 FOLLOWER]: Refusing update from remote peer fe3328dc118a4cae86180c14ef0d4d64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260812 11:10:57.933272 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.124:38157
--webserver_interface=127.4.26.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.124.keytab
--principal=oryx/127.4.26.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:38963,127.4.26.125:33193,127.4.26.124:38157
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:10:57.934221 15428 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.4.26.125:33193
I20260812 11:10:57.934383 15431 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:57.934834 15428 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } } }
I20260812 11:10:57.935138 15428 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:57.937662 15267 master.cc:537] Master@127.4.26.125:33193 shutting down...
W20260812 11:10:57.938777 14486 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260812 11:10:57.949559 14486 consensus_peers.cc:487] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 -> Peer 3507be9fe2f4400999bd423b26580f0c (127.4.26.125:33193): Couldn't send request to peer 3507be9fe2f4400999bd423b26580f0c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 11:10:57.951578 15267 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:10:57.952073 15267 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:10:57.952280 15267 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: stopping tablet replica
I20260812 11:10:57.961077 15267 master.cc:552] Master@127.4.26.125:33193 shutdown complete.
I20260812 11:10:57.961418 15267 master_runner.cc:305] Clearing existing system tablet
I20260812 11:10:57.962069 15267 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:57.962257 15267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:57.965690 15267 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260812 11:10:57.967908 15439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:57.968287 15267 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:57.968784 15267 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260812 11:10:57.968942 15267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/wal
uuid: "3507be9fe2f4400999bd423b26580f0c"
format_stamp: "Formatted at 2026-08-12 11:10:57 on dist-test-slave-rmhg"
server_key: "561d0b9bab14ddacfc99b00c551ef649"
server_key_iv: "e89b60f8668187195d0fb314aa51a874"
server_key_version: "encryptionkey@0"
I20260812 11:10:57.974844 15267 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:57.982592 15267 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 11:10:57.982985 15267 log.cc:1196] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260812 11:10:57.983558 15267 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: Deleting consensus metadata
I20260812 11:10:57.983876 15267 master_runner.cc:315] Copying system tablet from 127.4.26.126:38963
I20260812 11:10:57.986979 15267 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: tablet copy: Beginning tablet copy session from remote peer at address 127.4.26.126:38963
I20260812 11:10:58.003829 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:57.988196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41474 (local address 127.4.26.126:38963)
0812 11:10:57.988536 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:57.988544 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:57.988898 (+ 354us) server_negotiation.cc:407] Connection header received
0812 11:10:57.989147 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:57.989176 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:57.989265 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:57.989370 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:57.990399 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.991589 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.993501 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.994175 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.994319 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:57.996626 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:57.996633 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:57.996638 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:57.996682 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:58.000310 (+ 3628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.001353 (+ 1043us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.001359 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.001363 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.001549 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.002132 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.002137 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.002141 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.002528 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:58.002692 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:58.003198 (+ 506us) server_negotiation.cc:299] Negotiation successful
0812 11:10:58.003455 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197}
I20260812 11:10:58.003891 15446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:57.988186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:41474)
0812 11:10:57.988771 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:57.988792 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:57.988962 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:57.989414 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:57.989418 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:57.989920 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:57.990235 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:57.990248 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.991769 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.991775 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:57.993289 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:57.993307 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:57.994354 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:57.994360 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:57.994541 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:57.995291 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:57.995315 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:57.996398 (+ 1083us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:58.000514 (+ 4116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.000521 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.000525 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.001207 (+ 682us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.001750 (+ 543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.001755 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.001759 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.001996 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.002671 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:58.002676 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:58.002889 (+ 213us) client_negotiation.cc:769] Sending connection context
0812 11:10:58.003076 (+ 187us) client_negotiation.cc:240] Negotiation successful
0812 11:10:58.003410 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":353,"threads_started":1}
I20260812 11:10:58.005609 14539 tablet_copy_service.cc:140] P fe3328dc118a4cae86180c14ef0d4d64: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3507be9fe2f4400999bd423b26580f0c ({username='oryx', principal='oryx/127.4.26.125@KRBTEST.COM'} at 127.0.0.1:41474)
I20260812 11:10:58.006036 14539 tablet_copy_service.cc:161] P fe3328dc118a4cae86180c14ef0d4d64: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3507be9fe2f4400999bd423b26580f0c at {username='oryx', principal='oryx/127.4.26.125@KRBTEST.COM'} at 127.0.0.1:41474: session id = 3507be9fe2f4400999bd423b26580f0c-00000000000000000000000000000000
I20260812 11:10:58.011174 14539 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 11:10:58.014287 15267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 11:10:58.021733 15267 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: tablet copy: Starting download of 0 data blocks...
I20260812 11:10:58.022243 15267 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: tablet copy: Starting download of 1 WAL segments...
I20260812 11:10:58.026547 15267 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 11:10:58.031631 14539 tablet_copy_service.cc:342] P fe3328dc118a4cae86180c14ef0d4d64: Request end of tablet copy session 3507be9fe2f4400999bd423b26580f0c-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.4.26.125@KRBTEST.COM'} at 127.0.0.1:41474
I20260812 11:10:58.031903 14539 tablet_copy_service.cc:433] P fe3328dc118a4cae86180c14ef0d4d64: ending tablet copy session 3507be9fe2f4400999bd423b26580f0c-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3507be9fe2f4400999bd423b26580f0c
I20260812 11:10:58.045056 15267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:58.048076 15447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:58.048575 15448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:58.057267 15450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:58.062712 15267 server_base.cc:1034] running on GCE node
I20260812 11:10:58.063110 15267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:58.063848 15267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:58.065096 15267 hybrid_clock.cc:648] HybridClock initialized: now 1786533058065024 us; error 44 us; skew 500 ppm
I20260812 11:10:58.065398 15267 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:58 dist-test-slave-rmhg krb5kdc[14425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533058, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:58.067821 15267 init.cc:377] Logged in from keytab as oryx/127.4.26.125@KRBTEST.COM (short username oryx)
I20260812 11:10:58.073880 15267 webserver.cc:460] Webserver started at http://127.4.26.125:34099/ using document root <none> and password file <none>
I20260812 11:10:58.074254 15267 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:58.074347 15267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:58.077756 15267 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260812 11:10:58.079938 15461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:58.080403 15267 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:58.080592 15267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/wal
uuid: "3507be9fe2f4400999bd423b26580f0c"
format_stamp: "Formatted at 2026-08-12 11:10:57 on dist-test-slave-rmhg"
server_key: "561d0b9bab14ddacfc99b00c551ef649"
server_key_iv: "e89b60f8668187195d0fb314aa51a874"
server_key_version: "encryptionkey@0"
I20260812 11:10:58.080775 15267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:58.107906 15267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:58.112313 15267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:58.142872 15267 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.125:33193
I20260812 11:10:58.142901 15544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.125:33193 every 8 connection(s)
I20260812 11:10:58.144344 15267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-1/data/info.pb
I20260812 11:10:58.150100 15546 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:10:58.154469 15546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: Bootstrap starting.
I20260812 11:10:58.174899 15546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:10:58.175565 15546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: Bootstrap complete.
I20260812 11:10:58.176859 15546 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } }
I20260812 11:10:58.177222 15546 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3507be9fe2f4400999bd423b26580f0c, State: Initialized, Role: LEARNER
I20260812 11:10:58.177512 15546 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } }
I20260812 11:10:58.178442 15549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } } }
I20260812 11:10:58.178815 15546 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:58.178956 15549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: This master's current role is: LEARNER
I20260812 11:10:58.187572 15569 catalog_manager.cc:1259] Loaded cluster ID: e5eabb831a3749488b23faef0c1c0891
I20260812 11:10:58.187680 15569 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: loading cluster ID for follower catalog manager: success
I20260812 11:10:58.191416 15569 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: acquiring CA information for follower catalog manager: success
I20260812 11:10:58.194276 15569 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:10:58.256458 15258 heartbeater.cc:503] Master 127.4.26.126:38963 was elected leader, sending a full tablet report...
W20260812 11:10:58.348263 15435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:58.348629 15435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:58.348775 15435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:58.356349 15435 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:10:58.356495 15435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:58.356545 15435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:58.356621 15435 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:10:58.356689 15435 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:10:58.367489 15435 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:38963,127.4.26.125:33193,127.4.26.124:38157
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.124.keytab
--principal=oryx/127.4.26.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.124:38157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.26.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:58.368906 15435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:58.370368 15435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:58.384478 15574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:58.384567 15577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:58.384896 15575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:58.385244 15435 server_base.cc:1034] running on GCE node
I20260812 11:10:58.386112 15435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:58.387653 15435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:58.388876 15435 hybrid_clock.cc:648] HybridClock initialized: now 1786533058388828 us; error 45 us; skew 500 ppm
I20260812 11:10:58.389287 15435 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:58 dist-test-slave-rmhg krb5kdc[14425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533058, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:58.392602 15435 init.cc:377] Logged in from keytab as oryx/127.4.26.124@KRBTEST.COM (short username oryx)
I20260812 11:10:58.394362 15435 webserver.cc:460] Webserver started at http://127.4.26.124:34409/ using document root <none> and password file <none>
I20260812 11:10:58.395114 15435 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:58.395247 15435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:58.395560 15435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:10:58.398772 15435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/data/instance:
uuid: "034e13bde73543c6871b5ecf9b75c914"
format_stamp: "Formatted at 2026-08-12 11:10:58 on dist-test-slave-rmhg"
server_key: "5a3db0758e9392e04d32f386fcf2176a"
server_key_iv: "4138abc2e4d4671de233cfaad569ee2f"
server_key_version: "encryptionkey@0"
I20260812 11:10:58.399559 15435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/wal/instance:
uuid: "034e13bde73543c6871b5ecf9b75c914"
format_stamp: "Formatted at 2026-08-12 11:10:58 on dist-test-slave-rmhg"
server_key: "5a3db0758e9392e04d32f386fcf2176a"
server_key_iv: "4138abc2e4d4671de233cfaad569ee2f"
server_key_version: "encryptionkey@0"
I20260812 11:10:58.405088 15435 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:10:58.408738 15588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:58.410256 15435 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:58.410429 15435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/wal
uuid: "034e13bde73543c6871b5ecf9b75c914"
format_stamp: "Formatted at 2026-08-12 11:10:58 on dist-test-slave-rmhg"
server_key: "5a3db0758e9392e04d32f386fcf2176a"
server_key_iv: "4138abc2e4d4671de233cfaad569ee2f"
server_key_version: "encryptionkey@0"
I20260812 11:10:58.410635 15435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:58.426575 15435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:58.431221 15435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:58.431552 15435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:58.452821 15601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.437624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:33193 (local address 127.0.0.1:53546)
0812 11:10:58.445526 (+ 7902us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:58.445553 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:58.445746 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:58.446235 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:58.446242 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:58.446274 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:58.446531 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.446543 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.448379 (+ 1836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.448386 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.450348 (+ 1962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.450364 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.452038 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.452046 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.452200 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.452251 (+ 51us) client_negotiation.cc:769] Sending connection context
0812 11:10:58.452342 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 11:10:58.452464 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7749,"thread_start_us":7606,"threads_started":1}
I20260812 11:10:58.452924 15602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.437796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53546 (local address 127.4.26.125:33193)
0812 11:10:58.442106 (+ 4310us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:58.442114 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:58.445689 (+ 3575us) server_negotiation.cc:407] Connection header received
0812 11:10:58.445906 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:58.445912 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:58.446023 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:58.446150 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:58.446690 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.448210 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.450541 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.451813 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.451973 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.452244 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:58.452374 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 11:10:58.452551 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4118,"thread_start_us":3981,"threads_started":1}
I20260812 11:10:58.454355 15507 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260812 11:10:58.455086 15549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe3328dc118a4cae86180c14ef0d4d64. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } } }
I20260812 11:10:58.455371 15549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: This master's current role is: LEARNER
I20260812 11:10:58.457625 15435 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.124:38157
I20260812 11:10:58.457647 15673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.124:38157 every 8 connection(s)
I20260812 11:10:58.459183 15435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/data/info.pb
I20260812 11:10:58.460583 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 15435
I20260812 11:10:58.463860 15674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:10:58.473192 15674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:10:58 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.26.124@KRBTEST.COM
Aug 12 11:10:58 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533058, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.124@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM
I20260812 11:10:58.487170 15679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.462952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43056 (local address 127.4.26.124:38157)
0812 11:10:58.463877 (+ 925us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:58.463894 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:58.463951 (+ 57us) server_negotiation.cc:407] Connection header received
0812 11:10:58.466336 (+ 2385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:58.466368 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:58.466890 (+ 522us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:58.467381 (+ 491us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:58.468793 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.470959 (+ 2166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.472397 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.473500 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.473685 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.478619 (+ 4934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:58.478635 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:58.478650 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:58.478704 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:58.482420 (+ 3716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.483303 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.483312 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.483319 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.483623 (+ 304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.484015 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.484024 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.484028 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.484625 (+ 597us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:58.484914 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:58.485352 (+ 438us) server_negotiation.cc:299] Negotiation successful
0812 11:10:58.485871 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":630,"thread_start_us":403,"threads_started":1}
I20260812 11:10:58.492157 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.476205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41488 (local address 127.4.26.126:38963)
0812 11:10:58.476379 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:58.476384 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:58.477240 (+ 856us) server_negotiation.cc:407] Connection header received
0812 11:10:58.477466 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:58.477470 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:58.477543 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:58.477641 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:58.479045 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.479875 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.482100 (+ 2225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.482627 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.482771 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.486538 (+ 3767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:58.486543 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:58.486547 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:58.486581 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:58.489393 (+ 2812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.490195 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.490199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.490201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.490327 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.490693 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.490698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.490702 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.490993 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:58.491130 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:58.491585 (+ 455us) server_negotiation.cc:299] Negotiation successful
0812 11:10:58.491810 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 11:10:58.492204 15681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.476129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:41488)
0812 11:10:58.477068 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:58.477116 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:58.477321 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:58.477777 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:58.477785 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:58.478417 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:58.478850 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.478865 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.480037 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.480046 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.481939 (+ 1893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.481956 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.482800 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.482805 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.482970 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.483696 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:58.483714 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:58.486345 (+ 2631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:58.489540 (+ 3195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.489553 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.489559 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.490067 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.490432 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.490437 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.490440 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.490579 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.491117 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:58.491125 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:58.491284 (+ 159us) client_negotiation.cc:769] Sending connection context
0812 11:10:58.491442 (+ 158us) client_negotiation.cc:240] Negotiation successful
0812 11:10:58.491796 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":484,"threads_started":1}
I20260812 11:10:58.493796 15674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:10:58 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533058, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.124@KRBTEST.COM for oryx/127.4.26.125@KRBTEST.COM
I20260812 11:10:58.507467 15602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.494568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53554 (local address 127.4.26.125:33193)
0812 11:10:58.494758 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:58.494763 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:58.494952 (+ 189us) server_negotiation.cc:407] Connection header received
0812 11:10:58.495130 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:58.495133 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:58.495196 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:58.495272 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:58.496065 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.496822 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.498626 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.499027 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.499143 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.502499 (+ 3356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:58.502504 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:58.502508 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:58.502541 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:58.504997 (+ 2456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.505833 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.505837 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.505840 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.505970 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.506329 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.506333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.506335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.506587 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:58.506699 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:58.507060 (+ 361us) server_negotiation.cc:299] Negotiation successful
0812 11:10:58.507244 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 11:10:58.507608 15681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.494616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:33193 (local address 127.0.0.1:53554)
0812 11:10:58.494875 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:58.494892 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:58.495006 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:58.495321 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:58.495326 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:58.495759 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:58.495927 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.495937 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.496962 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.496966 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.498503 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.498519 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.499169 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.499175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.499380 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.499942 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:58.499965 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:58.502309 (+ 2344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:58.505184 (+ 2875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.505190 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.505194 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.505723 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.506070 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.506076 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.506080 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.506239 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.506686 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:58.506692 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:58.506848 (+ 156us) client_negotiation.cc:769] Sending connection context
0812 11:10:58.506977 (+ 129us) client_negotiation.cc:240] Negotiation successful
0812 11:10:58.507280 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148}
I20260812 11:10:58.508715 15674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:10:58 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533058, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.124@KRBTEST.COM for oryx/127.4.26.124@KRBTEST.COM
I20260812 11:10:58.521276 15681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.509452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:38157 (local address 127.0.0.1:43072)
0812 11:10:58.509673 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:58.509687 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:58.509790 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:58.510044 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:58.510049 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:58.510424 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:58.510559 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.510567 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.511511 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.511516 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.512376 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.512388 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.513063 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.513069 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.513296 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.513863 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:58.513880 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:58.515946 (+ 2066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:58.518837 (+ 2891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.518841 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.518846 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.519240 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.519571 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.519576 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.519580 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.519730 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.520274 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:58.520279 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:58.520416 (+ 137us) client_negotiation.cc:769] Sending connection context
0812 11:10:58.520530 (+ 114us) client_negotiation.cc:240] Negotiation successful
0812 11:10:58.520811 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":1}
I20260812 11:10:58.521350 15679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.509438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43072 (local address 127.4.26.124:38157)
0812 11:10:58.509599 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:58.509605 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:58.509747 (+ 142us) server_negotiation.cc:407] Connection header received
0812 11:10:58.509882 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:58.509887 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:58.509944 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:58.510015 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:58.510689 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.511395 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.512506 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.512913 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.513018 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.516127 (+ 3109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:58.516131 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:58.516134 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:58.516162 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:58.518674 (+ 2512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.519337 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.519342 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.519346 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.519471 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.519826 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.519831 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.519835 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.520170 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:58.520297 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:58.520623 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 11:10:58.520982 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":133,"server-negotiator.queue_time_us":46}
I20260812 11:10:58.526305 15674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: Bootstrap starting.
I20260812 11:10:58.529515 15674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: Neither blocks nor log segments found. Creating new log.
I20260812 11:10:58.530560 15674 log.cc:824] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: Log is configured to *not* fsync() on all Append() calls
I20260812 11:10:58.533807 15674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: No bootstrap required, opened a new log
I20260812 11:10:58.541144 15674 raft_consensus.cc:348] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } }
I20260812 11:10:58.541676 15674 raft_consensus.cc:374] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:10:58.541807 15674 raft_consensus.cc:729] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 034e13bde73543c6871b5ecf9b75c914, State: Initialized, Role: FOLLOWER
I20260812 11:10:58.542450 15674 consensus_queue.cc:260] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } }
I20260812 11:10:58.543403 15683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } } }
I20260812 11:10:58.543744 15683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:10:58.544608 15674 sys_catalog.cc:564] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 11:10:58.553750 15700 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:10:58.553889 15700 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:10:58.558946 15435 master_runner.cc:428] Detected that this master 034e13bde73543c6871b5ecf9b75c914 is joining an existing cluster
I20260812 11:10:58.559078 15435 master_runner.cc:432] Initiating AddMaster RPC to add 127.4.26.124:38157
I20260812 11:10:58.590966 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.563412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41492 (local address 127.4.26.126:38963)
0812 11:10:58.563597 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:58.563602 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:58.574034 (+ 10432us) server_negotiation.cc:407] Connection header received
0812 11:10:58.574240 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:58.574248 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:58.574356 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:58.574488 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:58.577620 (+ 3132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.578897 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.581119 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.581822 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.581928 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.584784 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:58.584791 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:58.584796 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:58.584850 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:58.587900 (+ 3050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.588538 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.588545 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.588549 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.588711 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.589114 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.589119 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.589123 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.589521 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:58.589731 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:58.590348 (+ 617us) server_negotiation.cc:299] Negotiation successful
0812 11:10:58.590589 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:10:58.593580 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 14600
I20260812 11:10:58.595726 15710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.563153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:41492)
0812 11:10:58.573818 (+ 10665us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:58.573851 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:58.574091 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:58.574738 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:58.574744 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:58.575616 (+ 872us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:58.576078 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.576096 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.579103 (+ 3007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.579108 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.580930 (+ 1822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.580944 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.582217 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.582224 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.582421 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.583243 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:58.583271 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:58.584539 (+ 1268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:58.588040 (+ 3501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.588046 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.588050 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.588410 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.588829 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.588834 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.588838 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.588999 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.589799 (+ 800us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:58.589804 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:58.590027 (+ 223us) client_negotiation.cc:769] Sending connection context
0812 11:10:58.591580 (+ 1553us) client_negotiation.cc:240] Negotiation successful
0812 11:10:58.595223 (+ 3643us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10426,"thread_start_us":10214,"threads_started":1}
I20260812 11:10:58.596192 15679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.563216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43078 (local address 127.4.26.124:38157)
0812 11:10:58.563839 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:58.563852 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:58.579119 (+ 15267us) server_negotiation.cc:407] Connection header received
0812 11:10:58.579328 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:58.579336 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:58.579422 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:58.579527 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:58.581091 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.582151 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.584295 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.584988 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.585076 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.589253 (+ 4177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:58.589259 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:58.589263 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:58.589297 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:58.593280 (+ 3983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.594053 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.594058 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.594061 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.594244 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.594625 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.594629 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.594632 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.594985 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:58.595125 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:58.595653 (+ 528us) server_negotiation.cc:299] Negotiation successful
0812 11:10:58.595876 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":292}
I20260812 11:10:58.597136 15714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.564045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:38157 (local address 127.0.0.1:43078)
0812 11:10:58.578978 (+ 14933us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:58.579001 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:58.579185 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:58.579621 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:58.579625 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:58.580543 (+ 918us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:58.580925 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.580942 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.582463 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.582467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.584125 (+ 1658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.584148 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.585398 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.585404 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.585562 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.586187 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:58.586211 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:58.588987 (+ 2776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:58.593412 (+ 4425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.593416 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.593420 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.593929 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.594373 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.594377 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.594380 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.594519 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.595227 (+ 708us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:58.595230 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:58.595404 (+ 174us) client_negotiation.cc:769] Sending connection context
0812 11:10:58.596405 (+ 1001us) client_negotiation.cc:240] Negotiation successful
0812 11:10:58.596694 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14806,"spinlock_wait_cycles":95616,"thread_start_us":14518,"threads_started":1}
I20260812 11:10:58.603570 15602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.563465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53564 (local address 127.4.26.125:33193)
0812 11:10:58.563665 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:58.563671 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:58.579184 (+ 15513us) server_negotiation.cc:407] Connection header received
0812 11:10:58.579343 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:58.579349 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:58.579448 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:58.579540 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:58.581483 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.582652 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.584834 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.585521 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.585636 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.589331 (+ 3695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:58.589338 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:58.589343 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:58.589387 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:58.592787 (+ 3400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.593669 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.593675 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.593679 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.593836 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.595076 (+ 1240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.595081 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.595085 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.595443 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:58.595591 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:58.602859 (+ 7268us) server_negotiation.cc:299] Negotiation successful
0812 11:10:58.603178 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 11:10:58.604832 15712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.564004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:33193 (local address 127.0.0.1:53564)
0812 11:10:58.578978 (+ 14974us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:58.579001 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:58.579181 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:58.580001 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:58.580005 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:58.580843 (+ 838us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:58.581302 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.581317 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.582907 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.582912 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.584640 (+ 1728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.584659 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.585934 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.585941 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.586122 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.586700 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:58.586723 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:58.587932 (+ 1209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:58.592953 (+ 5021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.592959 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.592964 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.593497 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.593990 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.593995 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.593998 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.594170 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.601200 (+ 7030us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:58.601205 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:58.601469 (+ 264us) client_negotiation.cc:769] Sending connection context
0812 11:10:58.603881 (+ 2412us) client_negotiation.cc:240] Negotiation successful
0812 11:10:58.604280 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14794,"spinlock_wait_cycles":1280,"thread_start_us":15663,"threads_started":1}
Aug 12 11:10:58 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533055, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.126@KRBTEST.COM for oryx/127.4.26.124@KRBTEST.COM
Aug 12 11:10:58 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.26.65@KRBTEST.COM
I20260812 11:10:58.618762 15601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.602232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:38157 (local address 127.0.0.1:43080)
0812 11:10:58.602454 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:58.602475 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:58.602613 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:58.602993 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:58.602999 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:58.603406 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:58.603560 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.603569 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.604819 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.604825 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.606181 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.606199 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.607281 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.607288 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.607484 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.608298 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:58.608325 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:58.611187 (+ 2862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:58.615522 (+ 4335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.615529 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.615534 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.616147 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.616689 (+ 542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.616695 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.616699 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.616916 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.617679 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:58.617685 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:58.617874 (+ 189us) client_negotiation.cc:769] Sending connection context
0812 11:10:58.618031 (+ 157us) client_negotiation.cc:240] Negotiation successful
0812 11:10:58.618356 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 11:10:58.619829 15679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.602277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43080 (local address 127.4.26.124:38157)
0812 11:10:58.602437 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:58.602443 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:58.602536 (+ 93us) server_negotiation.cc:407] Connection header received
0812 11:10:58.602753 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:58.602757 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:58.602846 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:58.602942 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:58.603866 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.604686 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.606356 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.607091 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.607243 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.611432 (+ 4189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:58.611440 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:58.611445 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:58.611489 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:58.615305 (+ 3816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.616342 (+ 1037us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.616347 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.616351 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.616515 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.617090 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.617095 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.617099 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.617513 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:58.619078 (+ 1565us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:58.619213 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 11:10:58.619487 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:10:58.621438 14509 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.4.26.124:38157: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "034e13bde73543c6871b5ecf9b75c914"
member_type: NON_VOTER
last_known_addr {
host: "127.4.26.124"
port: 38157
}
attrs {
promote: true
}
}
dest_uuid: "fe3328dc118a4cae86180c14ef0d4d64"
cas_config_opid_index: 5
I20260812 11:10:58.622355 14509 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } }
I20260812 11:10:58.623945 15428 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 034e13bde73543c6871b5ecf9b75c914 (127.4.26.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } } }
I20260812 11:10:58.625011 15715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.594801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37452 (local address 127.4.26.65:37083)
0812 11:10:58.605665 (+ 10864us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:58.605674 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:58.605707 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:10:58.605778 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:58.605788 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:58.606031 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:58.606226 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:58.607902 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.609040 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.610413 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.611073 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.611206 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.615949 (+ 4743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:58.615967 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:58.615986 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:58.616030 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:58.619435 (+ 3405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.621305 (+ 1870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.621318 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.621322 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.621507 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.622069 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.622075 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.622079 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.622594 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:58.622908 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:58.624238 (+ 1330us) server_negotiation.cc:299] Negotiation successful
0812 11:10:58.624592 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10654,"thread_start_us":10611,"threads_started":1}
I20260812 11:10:58.626585 14808 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:58.628475 15634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:10:58.632438 15634 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 FOLLOWER]: Refusing update from remote peer fe3328dc118a4cae86180c14ef0d4d64: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 11:10:58.641680 15507 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 LEARNER]: Refusing update from remote peer fe3328dc118a4cae86180c14ef0d4d64: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260812 11:10:58.644524 15718 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:10:58.648836 15428 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.4.26.124:38157
I20260812 11:10:58.649785 15435 master.cc:537] Master@127.4.26.124:38157 shutting down...
I20260812 11:10:58.651423 15428 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260812 11:10:58.653575 15719 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } } }
I20260812 11:10:58.654031 15719 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:58.664826 15634 raft_consensus.cc:858] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } }
W20260812 11:10:58.665082 15634 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } }
I20260812 11:10:58.675137 15507 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 034e13bde73543c6871b5ecf9b75c914 (127.4.26.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } } }
I20260812 11:10:58.679939 15549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } } }
I20260812 11:10:58.680248 15549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: This master's current role is: LEARNER
I20260812 11:10:58.681849 15718 raft_consensus.cc:1050] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64: attempting to promote NON_VOTER 3507be9fe2f4400999bd423b26580f0c to VOTER
I20260812 11:10:58.682789 15718 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } }
I20260812 11:10:58.685190 15507 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 LEARNER]: Refusing update from remote peer fe3328dc118a4cae86180c14ef0d4d64: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260812 11:10:58.685824 15428 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 11:10:58.688138 15720 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3507be9fe2f4400999bd423b26580f0c (127.4.26.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } } }
I20260812 11:10:58.693315 15505 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3507be9fe2f4400999bd423b26580f0c (127.4.26.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } } }
I20260812 11:10:58.697540 15720 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } } }
I20260812 11:10:58.698078 15719 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } } }
I20260812 11:10:58.698343 15719 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:58.698575 15720 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:58.699152 15549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } } }
I20260812 11:10:58.699388 15549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:10:58.707842 15634 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3507be9fe2f4400999bd423b26580f0c (127.4.26.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } } }
W20260812 11:10:58.715659 14489 consensus_peers.cc:487] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 -> Peer 034e13bde73543c6871b5ecf9b75c914 (127.4.26.124:38157): Couldn't send request to peer 034e13bde73543c6871b5ecf9b75c914. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260812 11:10:58.717446 15683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe3328dc118a4cae86180c14ef0d4d64. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } } }
I20260812 11:10:58.717778 15683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260812 11:10:58.717470 15730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } } }
I20260812 11:10:58.717904 15730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260812 11:10:58.718334 15737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: NON_VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: true } } }
I20260812 11:10:58.718809 15737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260812 11:10:58.721277 15435 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260812 11:10:58.721815 15435 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260812 11:10:58.722010 15435 tablet_replica.cc:330] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: stopping tablet replica
I20260812 11:10:58.740309 15435 master.cc:552] Master@127.4.26.124:38157 shutdown complete.
I20260812 11:10:58.740422 15435 master_runner.cc:305] Clearing existing system tablet
I20260812 11:10:58.740929 15435 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:58.741060 15435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:58.743625 15435 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20260812 11:10:58.745494 15740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:58.745932 15435 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:58.746250 15435 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260812 11:10:58.746377 15435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/wal
uuid: "034e13bde73543c6871b5ecf9b75c914"
format_stamp: "Formatted at 2026-08-12 11:10:58 on dist-test-slave-rmhg"
server_key: "5a3db0758e9392e04d32f386fcf2176a"
server_key_iv: "4138abc2e4d4671de233cfaad569ee2f"
server_key_version: "encryptionkey@0"
I20260812 11:10:58.750276 15435 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:10:58.755926 15435 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260812 11:10:58.756135 15435 log.cc:1196] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260812 11:10:58.756621 15435 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: Deleting consensus metadata
I20260812 11:10:58.756887 15435 master_runner.cc:315] Copying system tablet from 127.4.26.126:38963
I20260812 11:10:58.759706 15435 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: tablet copy: Beginning tablet copy session from remote peer at address 127.4.26.126:38963
I20260812 11:10:58.776291 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.760646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41496 (local address 127.4.26.126:38963)
0812 11:10:58.760925 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:58.760932 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:58.761587 (+ 655us) server_negotiation.cc:407] Connection header received
0812 11:10:58.762093 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:58.762097 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:58.762175 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:58.762278 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:58.763302 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.764216 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.767644 (+ 3428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.768098 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.768226 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.770526 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:58.770532 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:58.770536 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:58.770576 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:58.773407 (+ 2831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.774159 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.774164 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.774167 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.774312 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:58.774760 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:58.774764 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:58.774766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:58.775095 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:58.775243 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:58.775682 (+ 439us) server_negotiation.cc:299] Negotiation successful
0812 11:10:58.775932 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260812 11:10:58.776373 15750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:58.760596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:41496)
0812 11:10:58.761444 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:58.761472 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:58.761857 (+ 385us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:58.762346 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:58.762354 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:58.762869 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:58.763119 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.763131 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.766327 (+ 3196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.766333 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.767420 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:58.767441 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:58.768286 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:58.768293 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:58.768494 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:58.769370 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:58.769392 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:58.770260 (+ 868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:58.773581 (+ 3321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.773588 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.773593 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.774006 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.774438 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:58.774444 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:58.774449 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:58.774630 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:58.775222 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:58.775228 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:58.775398 (+ 170us) client_negotiation.cc:769] Sending connection context
0812 11:10:58.775515 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 11:10:58.775913 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":531,"threads_started":1}
I20260812 11:10:58.777383 14539 tablet_copy_service.cc:140] P fe3328dc118a4cae86180c14ef0d4d64: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 034e13bde73543c6871b5ecf9b75c914 ({username='oryx', principal='oryx/127.4.26.124@KRBTEST.COM'} at 127.0.0.1:41496)
I20260812 11:10:58.777581 14539 tablet_copy_service.cc:161] P fe3328dc118a4cae86180c14ef0d4d64: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 034e13bde73543c6871b5ecf9b75c914 at {username='oryx', principal='oryx/127.4.26.124@KRBTEST.COM'} at 127.0.0.1:41496: session id = 034e13bde73543c6871b5ecf9b75c914-00000000000000000000000000000000
I20260812 11:10:58.780115 14539 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64: Tablet Copy: opened 0 blocks and 1 log segments
I20260812 11:10:58.782267 15435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260812 11:10:58.787467 15435 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: tablet copy: Starting download of 0 data blocks...
I20260812 11:10:58.787846 15435 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: tablet copy: Starting download of 1 WAL segments...
I20260812 11:10:58.790424 15435 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260812 11:10:58.793879 14539 tablet_copy_service.cc:342] P fe3328dc118a4cae86180c14ef0d4d64: Request end of tablet copy session 034e13bde73543c6871b5ecf9b75c914-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.4.26.124@KRBTEST.COM'} at 127.0.0.1:41496
I20260812 11:10:58.794032 14539 tablet_copy_service.cc:433] P fe3328dc118a4cae86180c14ef0d4d64: ending tablet copy session 034e13bde73543c6871b5ecf9b75c914-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 034e13bde73543c6871b5ecf9b75c914
I20260812 11:10:58.798009 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 14600
I20260812 11:10:58.818560 15435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:58.823203 15752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:58.827054 15753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:58.837818 15435 server_base.cc:1034] running on GCE node
W20260812 11:10:58.839448 15756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:58.840126 15435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:58.840169 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:37083
--local_ip_for_outbound_sockets=127.4.26.65
--tserver_master_addrs=127.4.26.126:38963
--webserver_port=41605
--webserver_interface=127.4.26.65
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.65.keytab
--principal=oryx/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.4.26.126:38963,127.4.26.125:33193
--tserver_master_addrs=127.4.26.126:38963,127.4.26.125:33193,127.4.26.124:38157 with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:10:58.841001 15435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:58.842232 15435 hybrid_clock.cc:648] HybridClock initialized: now 1786533058842187 us; error 40 us; skew 500 ppm
I20260812 11:10:58.842523 15435 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:58 dist-test-slave-rmhg krb5kdc[14425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533058, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:58.845428 15435 init.cc:377] Logged in from keytab as oryx/127.4.26.124@KRBTEST.COM (short username oryx)
I20260812 11:10:58.847180 15435 webserver.cc:460] Webserver started at http://127.4.26.124:43827/ using document root <none> and password file <none>
I20260812 11:10:58.847571 15435 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:58.847698 15435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:58.854076 15435 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:10:58.856382 15769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:58.856864 15435 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260812 11:10:58.857010 15435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/wal
uuid: "034e13bde73543c6871b5ecf9b75c914"
format_stamp: "Formatted at 2026-08-12 11:10:58 on dist-test-slave-rmhg"
server_key: "5a3db0758e9392e04d32f386fcf2176a"
server_key_iv: "4138abc2e4d4671de233cfaad569ee2f"
server_key_version: "encryptionkey@0"
I20260812 11:10:58.857270 15435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:58.878453 15435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:58.882884 15435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:58.912416 15435 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.124:38157
I20260812 11:10:58.912474 15849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.124:38157 every 8 connection(s)
I20260812 11:10:58.913653 15435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/master-2/data/info.pb
I20260812 11:10:58.919610 15850 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:10:58.924180 15850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: Bootstrap starting.
I20260812 11:10:58.941401 15850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:10:58.942041 15850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: Bootstrap complete.
I20260812 11:10:58.943312 15850 raft_consensus.cc:348] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } }
I20260812 11:10:58.943620 15850 raft_consensus.cc:729] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 034e13bde73543c6871b5ecf9b75c914, State: Initialized, Role: LEARNER
I20260812 11:10:58.943886 15850 consensus_queue.cc:260] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } }
I20260812 11:10:58.944783 15854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } } }
I20260812 11:10:58.945089 15850 sys_catalog.cc:564] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:10:58.945324 15854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:10:58.955912 15871 catalog_manager.cc:1259] Loaded cluster ID: e5eabb831a3749488b23faef0c1c0891
I20260812 11:10:58.956049 15871 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: loading cluster ID for follower catalog manager: success
I20260812 11:10:58.959570 15871 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: acquiring CA information for follower catalog manager: success
I20260812 11:10:58.962179 15871 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 11:10:59.221189 15767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:59.221544 15767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:59.221689 15767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:59.230660 15767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:59.230826 15767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:59.231026 15767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:10:59.241773 15767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.65.keytab
--principal=oryx/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:37083
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=41605
--tserver_master_addrs=127.4.26.126:38963,127.4.26.125:33193,127.4.26.124:38157
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:59.243305 15767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:59.244808 15767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:59.258637 15879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:59.259292 15883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:59.258636 15878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:59.259938 15767 server_base.cc:1034] running on GCE node
I20260812 11:10:59.260780 15767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:59.261868 15767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:59.263108 15767 hybrid_clock.cc:648] HybridClock initialized: now 1786533059263035 us; error 62 us; skew 500 ppm
I20260812 11:10:59.263438 15767 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:59 dist-test-slave-rmhg krb5kdc[14425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533059, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:59.267068 15767 init.cc:377] Logged in from keytab as oryx/127.4.26.65@KRBTEST.COM (short username oryx)
I20260812 11:10:59.268747 15767 webserver.cc:460] Webserver started at http://127.4.26.65:41605/ using document root <none> and password file <none>
I20260812 11:10:59.269546 15767 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:59.269681 15767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:59.275506 15767 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:10:59.278689 15894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:59.280265 15767 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:10:59.280433 15767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "50c81efc0e36481abeda1faaad9fc87d"
format_stamp: "Formatted at 2026-08-12 11:10:56 on dist-test-slave-rmhg"
server_key: "e16ec56089a828ef1fa47304f5baddfa"
server_key_iv: "12c7ff349569140e72fe95d948987dd7"
server_key_version: "encryptionkey@0"
I20260812 11:10:59.281574 15767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:59.300063 15767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:59.303339 15906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:59.296874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:38157 (local address 127.0.0.1:43096)
0812 11:10:59.297375 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:59.297399 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:59.297558 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:59.298391 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:59.298396 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:59.298427 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:10:59.298640 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:59.298651 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.299962 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.299966 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:59.301281 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:59.301298 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.302492 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.302498 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:59.302714 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:59.302752 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 11:10:59.302846 (+ 94us) client_negotiation.cc:240] Negotiation successful
0812 11:10:59.303004 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":259,"threads_started":1}
I20260812 11:10:59.303339 15907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:59.297046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43096 (local address 127.4.26.124:38157)
0812 11:10:59.298045 (+ 999us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:59.298050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:59.298067 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:10:59.298139 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:59.298143 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:59.298214 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:59.298325 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:10:59.298796 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.299796 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.301452 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.302300 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.302438 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:59.302713 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:59.302885 (+ 172us) server_negotiation.cc:299] Negotiation successful
0812 11:10:59.303024 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":890,"thread_start_us":774,"threads_started":1}
I20260812 11:10:59.304342 15811 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260812 11:10:59.304802 15854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe3328dc118a4cae86180c14ef0d4d64. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } } }
I20260812 11:10:59.305105 15854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: This master's current role is: LEARNER
I20260812 11:10:59.305439 15767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:59.305721 15767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:59.306787 15767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:59.308380 15767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:59.308486 15767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:59.308602 15767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:59.308676 15767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:59.342065 15767 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:37083
I20260812 11:10:59.342151 16085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:37083 every 8 connection(s)
I20260812 11:10:59.343647 15767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:10:59.349758 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 15767
I20260812 11:10:59.350133 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 14833
Aug 12 11:10:59 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533059, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.125@KRBTEST.COM
Aug 12 11:10:59 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533059, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.124@KRBTEST.COM
Aug 12 11:10:59 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533059, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM
Aug 12 11:10:59 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.26.66@KRBTEST.COM
I20260812 11:10:59.375007 15907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:59.347998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:50591 (local address 127.4.26.124:38157)
0812 11:10:59.348189 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:59.348195 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:59.348444 (+ 249us) server_negotiation.cc:407] Connection header received
0812 11:10:59.352565 (+ 4121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:59.352572 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:59.352669 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:59.352744 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:59.355804 (+ 3060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.356910 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.360003 (+ 3093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.360671 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.360784 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:59.367235 (+ 6451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:59.367243 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:59.367248 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:59.367296 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:59.370768 (+ 3472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:59.371942 (+ 1174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:59.371948 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:59.371951 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:59.372141 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:59.372707 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:59.372712 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:59.372716 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:59.373083 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:59.373259 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:59.374402 (+ 1143us) server_negotiation.cc:299] Negotiation successful
0812 11:10:59.374673 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:10:59.375294 16093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:59.346668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:48241 (local address 127.4.26.126:38963)
0812 11:10:59.347161 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:59.347168 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:59.355808 (+ 8640us) server_negotiation.cc:407] Connection header received
0812 11:10:59.356087 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:59.356093 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:59.356173 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:59.356251 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:59.357785 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.358989 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.361026 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.361702 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.361818 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:59.368023 (+ 6205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:59.368031 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:59.368037 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:59.368085 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:59.371716 (+ 3631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:59.372885 (+ 1169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:59.372891 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:59.372894 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:59.373048 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:59.373566 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:59.373572 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:59.373575 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:59.373966 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:59.374103 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:59.374643 (+ 540us) server_negotiation.cc:299] Negotiation successful
0812 11:10:59.374898 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":230,"threads_started":1}
I20260812 11:10:59.376439 16095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:59.347421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:44313 (local address 127.4.26.125:33193)
0812 11:10:59.348524 (+ 1103us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:59.348530 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:59.349790 (+ 1260us) server_negotiation.cc:407] Connection header received
0812 11:10:59.352658 (+ 2868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:59.352665 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:59.352777 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:59.352882 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:59.356172 (+ 3290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.357412 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.360018 (+ 2606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.360698 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.360815 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:59.366442 (+ 5627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:59.366452 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:59.366457 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:59.366511 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:59.370990 (+ 4479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:59.372009 (+ 1019us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:59.372014 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:59.372018 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:59.372178 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:59.372706 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:59.372711 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:59.372715 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:59.373112 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:59.373278 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:59.375843 (+ 2565us) server_negotiation.cc:299] Negotiation successful
0812 11:10:59.376100 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":981,"thread_start_us":871,"threads_started":1}
I20260812 11:10:59.377048 16094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:59.347318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:38157 (local address 127.4.26.65:50591)
0812 11:10:59.348269 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:59.348324 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:59.352184 (+ 3860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:59.353320 (+ 1136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:59.353334 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:59.354695 (+ 1361us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:59.355578 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:59.355610 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.357193 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.357199 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:59.359811 (+ 2612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:59.359826 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.361245 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.361253 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:59.361683 (+ 430us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:59.363189 (+ 1506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:59.363209 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:59.366937 (+ 3728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:59.370984 (+ 4047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:59.370996 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:59.371019 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:59.371820 (+ 801us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:59.372291 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:59.372295 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:59.372299 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:59.372567 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:59.373366 (+ 799us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:59.373376 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:59.373907 (+ 531us) client_negotiation.cc:769] Sending connection context
0812 11:10:59.375307 (+ 1400us) client_negotiation.cc:240] Negotiation successful
0812 11:10:59.375624 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"mutex_wait_us":606,"spinlock_wait_cycles":2816,"thread_start_us":797,"threads_started":1}
I20260812 11:10:59.377110 16099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:59.348445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.65:48241)
0812 11:10:59.355697 (+ 7252us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:59.355717 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:59.355931 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:59.356537 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:59.356542 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:59.357196 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:59.357572 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:59.357593 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.359215 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.359220 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:59.360848 (+ 1628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:59.360864 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.361922 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.361930 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:59.362097 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:59.362733 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:59.362780 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:59.367713 (+ 4933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:59.372093 (+ 4380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:59.372099 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:59.372102 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:59.372707 (+ 605us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:59.373232 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:59.373238 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:59.373241 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:59.373422 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:59.374191 (+ 769us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:59.374195 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:59.374347 (+ 152us) client_negotiation.cc:769] Sending connection context
0812 11:10:59.375501 (+ 1154us) client_negotiation.cc:240] Negotiation successful
0812 11:10:59.375815 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7108,"mutex_wait_us":19,"thread_start_us":6946,"threads_started":1}
I20260812 11:10:59.377986 16097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:59.347977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:33193 (local address 127.4.26.65:44313)
0812 11:10:59.349602 (+ 1625us) negotiation.cc:107] Waiting for socket to connect
0812 11:10:59.349619 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:10:59.352190 (+ 2571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:10:59.353319 (+ 1129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:10:59.353334 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:10:59.354403 (+ 1069us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:10:59.355974 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:59.355987 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.357656 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.357660 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:59.359818 (+ 2158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:10:59.359834 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.361245 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.361253 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:10:59.361678 (+ 425us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:59.362638 (+ 960us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:10:59.362685 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:10:59.365998 (+ 3313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:10:59.371194 (+ 5196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:59.371200 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:59.371204 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:59.371877 (+ 673us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:59.372300 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:10:59.372305 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:10:59.372308 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:10:59.372558 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:10:59.373366 (+ 808us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:10:59.373376 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:10:59.373908 (+ 532us) client_negotiation.cc:769] Sending connection context
0812 11:10:59.374259 (+ 351us) client_negotiation.cc:240] Negotiation successful
0812 11:10:59.374872 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1483,"mutex_wait_us":124,"spinlock_wait_cycles":52096,"thread_start_us":1350,"threads_started":1}
I20260812 11:10:59.378660 16107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:10:59.351578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56404 (local address 127.4.26.66:40653)
0812 11:10:59.354985 (+ 3407us) server_negotiation.cc:206] Beginning negotiation
0812 11:10:59.354994 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:10:59.355027 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:10:59.355109 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:10:59.355117 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:10:59.355397 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:10:59.355556 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:10:59.358397 (+ 2841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.359964 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.362011 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:10:59.362971 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:10:59.363114 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:10:59.370105 (+ 6991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:10:59.370128 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:10:59.370154 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:10:59.370203 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:10:59.374159 (+ 3956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:59.375234 (+ 1075us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:59.375246 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:59.375249 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:59.375514 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:10:59.375998 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:10:59.376003 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:10:59.376007 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:10:59.376451 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:10:59.376766 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0812 11:10:59.377963 (+ 1197us) server_negotiation.cc:299] Negotiation successful
0812 11:10:59.378275 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":340,"threads_started":1}
I20260812 11:10:59.378829 16087 heartbeater.cc:347] Connected to a master server at 127.4.26.124:38157
I20260812 11:10:59.378875 16089 heartbeater.cc:347] Connected to a master server at 127.4.26.126:38963
I20260812 11:10:59.379158 16087 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:59.379163 16089 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:59.380290 16087 heartbeater.cc:511] Master 127.4.26.124:38157 requested a full tablet report, sending...
I20260812 11:10:59.380326 15042 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:10:59.380316 16089 heartbeater.cc:511] Master 127.4.26.126:38963 requested a full tablet report, sending...
I20260812 11:10:59.381709 16090 heartbeater.cc:347] Connected to a master server at 127.4.26.125:33193
I20260812 11:10:59.381862 16090 heartbeater.cc:464] Registering TS with master...
I20260812 11:10:59.382341 16090 heartbeater.cc:511] Master 127.4.26.125:33193 requested a full tablet report, sending...
I20260812 11:10:59.382366 14509 ts_manager.cc:194] Re-registered known tserver with Master: 50c81efc0e36481abeda1faaad9fc87d (127.4.26.65:37083)
I20260812 11:10:59.383435 14509 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:48241
I20260812 11:10:59.383589 15797 ts_manager.cc:194] Registered new tserver with Master: 50c81efc0e36481abeda1faaad9fc87d (127.4.26.65:37083)
I20260812 11:10:59.384068 15489 ts_manager.cc:194] Registered new tserver with Master: 50c81efc0e36481abeda1faaad9fc87d (127.4.26.65:37083)
I20260812 11:10:59.465307 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 14833
I20260812 11:10:59.489852 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:40653
--local_ip_for_outbound_sockets=127.4.26.66
--tserver_master_addrs=127.4.26.126:38963
--webserver_port=36497
--webserver_interface=127.4.26.66
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.66.keytab
--principal=oryx/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.4.26.126:38963,127.4.26.125:33193
--tserver_master_addrs=127.4.26.126:38963,127.4.26.125:33193,127.4.26.124:38157 with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:10:59.698587 15720 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: NON_VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: true } } }
I20260812 11:10:59.698985 15720 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:59.701432 16113 raft_consensus.cc:1050] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64: attempting to promote NON_VOTER 034e13bde73543c6871b5ecf9b75c914 to VOTER
I20260812 11:10:59.702476 16113 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } }
I20260812 11:10:59.705567 15505 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 FOLLOWER]: Refusing update from remote peer fe3328dc118a4cae86180c14ef0d4d64: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260812 11:10:59.705567 15811 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 LEARNER]: Refusing update from remote peer fe3328dc118a4cae86180c14ef0d4d64: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260812 11:10:59.706277 15720 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 11:10:59.706761 16114 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 11:10:59.710878 16113 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 034e13bde73543c6871b5ecf9b75c914 (127.4.26.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } } }
I20260812 11:10:59.711905 15505 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 034e13bde73543c6871b5ecf9b75c914 (127.4.26.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } } }
I20260812 11:10:59.711968 15811 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 034e13bde73543c6871b5ecf9b75c914 (127.4.26.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } } }
I20260812 11:10:59.715240 16114 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } } }
I20260812 11:10:59.715586 16114 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:59.715803 16114 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } } }
I20260812 11:10:59.716033 16114 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:59.717484 15854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } } }
I20260812 11:10:59.717778 15854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:10:59.719135 16128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } } }
I20260812 11:10:59.719875 16113 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fe3328dc118a4cae86180c14ef0d4d64" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } } }
I20260812 11:10:59.720095 16113 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64 [sys.catalog]: This master's current role is: LEADER
I20260812 11:10:59.720089 16128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: This master's current role is: FOLLOWER
W20260812 11:10:59.854161 16111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:10:59.854477 16111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:10:59.854605 16111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:10:59.862886 16111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:10:59.863059 16111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:10:59.863215 16111 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:10:59.874298 16111 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.66.keytab
--principal=oryx/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:40653
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=36497
--tserver_master_addrs=127.4.26.126:38963,127.4.26.125:33193,127.4.26.124:38157
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:10:59.875830 16111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:10:59.877727 16111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:10:59.893216 16137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:59.893311 16144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:10:59.893271 16140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:10:59.894017 16111 server_base.cc:1034] running on GCE node
I20260812 11:10:59.894739 16111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:10:59.895780 16111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:10:59.897002 16111 hybrid_clock.cc:648] HybridClock initialized: now 1786533059896950 us; error 76 us; skew 500 ppm
I20260812 11:10:59.897396 16111 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:10:59 dist-test-slave-rmhg krb5kdc[14425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533059, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:10:59.901928 16111 init.cc:377] Logged in from keytab as oryx/127.4.26.66@KRBTEST.COM (short username oryx)
I20260812 11:10:59.903685 16111 webserver.cc:460] Webserver started at http://127.4.26.66:36497/ using document root <none> and password file <none>
I20260812 11:10:59.904450 16111 fs_manager.cc:359] Metadata directory not provided
I20260812 11:10:59.904593 16111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:10:59.910835 16111 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:10:59.914182 16155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:59.916006 16111 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:10:59.916214 16111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "e4167a41432a476688a1acac83242072"
format_stamp: "Formatted at 2026-08-12 11:10:56 on dist-test-slave-rmhg"
server_key: "38bbb0bc3e299527331716d833539c17"
server_key_iv: "d7548324bcdb6f2e020862a604582db0"
server_key_version: "encryptionkey@0"
I20260812 11:10:59.917304 16111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:10:59.955808 16111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:10:59.960395 16111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:10:59.960705 16111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:10:59.961845 16111 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:10:59.963385 16111 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:10:59.963491 16111 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:59.963613 16111 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:10:59.963688 16111 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:10:59.996949 16111 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:40653
I20260812 11:10:59.997011 16349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:40653 every 8 connection(s)
I20260812 11:10:59.998709 16111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:11:00.007922 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 16111
I20260812 11:11:00.008285 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 15061
Aug 12 11:11:00 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533059, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.125@KRBTEST.COM
Aug 12 11:11:00 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533059, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM
Aug 12 11:11:00 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533059, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.124@KRBTEST.COM
Aug 12 11:11:00 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.26.67@KRBTEST.COM
I20260812 11:11:00.045032 16364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.003423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:33489 (local address 127.4.26.125:33193)
0812 11:11:00.018714 (+ 15291us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:00.018722 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:00.018747 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:11:00.018819 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:00.018824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:00.018922 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:00.019048 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:00.025026 (+ 5978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.026403 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.029595 (+ 3192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.030225 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.031476 (+ 1251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.035446 (+ 3970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:00.035454 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:00.035459 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:00.035520 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:00.040077 (+ 4557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.041402 (+ 1325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.041408 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.041412 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.041598 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.042223 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.042229 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.042232 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.042634 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:00.042791 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:00.044343 (+ 1552us) server_negotiation.cc:299] Negotiation successful
0812 11:11:00.044615 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15124,"thread_start_us":14964,"threads_started":1}
I20260812 11:11:00.045938 16365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.002904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:33193 (local address 127.4.26.66:33489)
0812 11:11:00.011373 (+ 8469us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:00.011449 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:00.016828 (+ 5379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:00.020445 (+ 3617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:00.020462 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:00.023500 (+ 3038us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:00.024672 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.024744 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.026722 (+ 1978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.026730 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.029304 (+ 2574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.029330 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.030555 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.030564 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.030937 (+ 373us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.031832 (+ 895us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:00.031869 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:00.035105 (+ 3236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:00.040279 (+ 5174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:00.040292 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:00.040320 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:00.041260 (+ 940us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:00.041751 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:00.041756 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:00.041760 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:00.042051 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:00.042872 (+ 821us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:00.042883 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:00.043398 (+ 515us) client_negotiation.cc:769] Sending connection context
0812 11:11:00.043725 (+ 327us) client_negotiation.cc:240] Negotiation successful
0812 11:11:00.044356 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8075,"thread_start_us":26341,"threads_started":1}
I20260812 11:11:00.047520 16352 heartbeater.cc:347] Connected to a master server at 127.4.26.125:33193
I20260812 11:11:00.047884 16352 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:00.048966 16352 heartbeater.cc:511] Master 127.4.26.125:33193 requested a full tablet report, sending...
I20260812 11:11:00.050050 16360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.003050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.66:44353)
0812 11:11:00.029784 (+ 26734us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:00.029810 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:00.029975 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:00.031081 (+ 1106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:00.031085 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:00.031865 (+ 780us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:00.032257 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.032270 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.033767 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.033773 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.035291 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.035303 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.036543 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.036551 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.036970 (+ 419us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.037653 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:00.037679 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:00.041300 (+ 3621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:00.046175 (+ 4875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:00.046180 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:00.046183 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:00.046798 (+ 615us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:00.047361 (+ 563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:00.047367 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:00.047371 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:00.047535 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:00.048759 (+ 1224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:00.048764 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:00.048978 (+ 214us) client_negotiation.cc:769] Sending connection context
0812 11:11:00.049222 (+ 244us) client_negotiation.cc:240] Negotiation successful
0812 11:11:00.049534 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26584,"mutex_wait_us":147,"thread_start_us":27176,"threads_started":1}
I20260812 11:11:00.051190 15489 ts_manager.cc:194] Registered new tserver with Master: e4167a41432a476688a1acac83242072 (127.4.26.66:40653)
I20260812 11:11:00.051388 16355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.002091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:44353 (local address 127.4.26.126:38963)
0812 11:11:00.027884 (+ 25793us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:00.027892 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:00.030519 (+ 2627us) server_negotiation.cc:407] Connection header received
0812 11:11:00.030603 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:00.030609 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:00.030714 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:00.030837 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:00.032460 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.033591 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.035462 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.036169 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.036293 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.041517 (+ 5224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:00.041525 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:00.041530 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:00.041584 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:00.046037 (+ 4453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.047061 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.047066 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.047069 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.047250 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.048139 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.048144 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.048147 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.048602 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:00.050547 (+ 1945us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:00.050740 (+ 193us) server_negotiation.cc:299] Negotiation successful
0812 11:11:00.050984 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25625,"thread_start_us":26290,"threads_started":1}
I20260812 11:11:00.051909 16359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.003664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:38157 (local address 127.4.26.66:57155)
0812 11:11:00.030539 (+ 26875us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:00.030556 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:00.030669 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:00.031270 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:00.031274 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:00.033319 (+ 2045us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:00.033630 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.033644 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.035195 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.035200 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.036830 (+ 1630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.036844 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.037963 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.037970 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.038176 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.039148 (+ 972us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:00.039171 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:00.042026 (+ 2855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:00.048075 (+ 6049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:00.048079 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:00.048083 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:00.048668 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:00.049297 (+ 629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:00.049302 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:00.049305 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:00.049512 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:00.050545 (+ 1033us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:00.050550 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:00.050727 (+ 177us) client_negotiation.cc:769] Sending connection context
0812 11:11:00.050844 (+ 117us) client_negotiation.cc:240] Negotiation successful
0812 11:11:00.051123 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26753,"mutex_wait_us":1,"thread_start_us":7185,"threads_started":1}
I20260812 11:11:00.051952 16368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.009688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33508 (local address 127.4.26.67:45777)
0812 11:11:00.029349 (+ 19661us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:00.029359 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:00.029395 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:11:00.029472 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:00.029482 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:00.029810 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:00.032253 (+ 2443us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:00.032516 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.034039 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.035823 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.036761 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.038087 (+ 1326us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.043030 (+ 4943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:00.043049 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:00.043071 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:00.043125 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:00.047474 (+ 4349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.048408 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.048417 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.048420 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.048597 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.049142 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.049181 (+ 39us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.049185 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.049679 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:00.051109 (+ 1430us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:00.051284 (+ 175us) server_negotiation.cc:299] Negotiation successful
0812 11:11:00.051566 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19416,"thread_start_us":20255,"threads_started":1}
I20260812 11:11:00.052439 16351 heartbeater.cc:347] Connected to a master server at 127.4.26.126:38963
I20260812 11:11:00.052568 16351 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:00.053030 16357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.002184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:57155 (local address 127.4.26.124:38157)
0812 11:11:00.028379 (+ 26195us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:00.028385 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:00.030798 (+ 2413us) server_negotiation.cc:407] Connection header received
0812 11:11:00.030874 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:00.030879 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:00.030955 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:00.031051 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:00.033828 (+ 2777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.035016 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.037006 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.037726 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.037861 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.042286 (+ 4425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:00.042293 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:00.042297 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:00.042342 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:00.047955 (+ 5613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.048816 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.048821 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.048824 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.049112 (+ 288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.049649 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.049654 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.049658 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.050019 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:00.052341 (+ 2322us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:00.052493 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 11:11:00.052750 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26024,"thread_start_us":25860,"threads_started":1}
I20260812 11:11:00.053076 16351 heartbeater.cc:511] Master 127.4.26.126:38963 requested a full tablet report, sending...
I20260812 11:11:00.053431 15252 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:00.053958 16350 heartbeater.cc:347] Connected to a master server at 127.4.26.124:38157
I20260812 11:11:00.054098 16350 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:00.054134 14509 ts_manager.cc:194] Re-registered known tserver with Master: e4167a41432a476688a1acac83242072 (127.4.26.66:40653)
I20260812 11:11:00.054550 16350 heartbeater.cc:511] Master 127.4.26.124:38157 requested a full tablet report, sending...
I20260812 11:11:00.055157 14509 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:44353
I20260812 11:11:00.055850 15797 ts_manager.cc:194] Registered new tserver with Master: e4167a41432a476688a1acac83242072 (127.4.26.66:40653)
I20260812 11:11:00.139400 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 15061
I20260812 11:11:00.172288 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:45777
--local_ip_for_outbound_sockets=127.4.26.67
--tserver_master_addrs=127.4.26.126:38963
--webserver_port=42591
--webserver_interface=127.4.26.67
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.67.keytab
--principal=oryx/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.4.26.126:38963,127.4.26.125:33193
--tserver_master_addrs=127.4.26.126:38963,127.4.26.125:33193,127.4.26.124:38157 with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:11:00.386508 16089 heartbeater.cc:503] Master 127.4.26.126:38963 was elected leader, sending a full tablet report...
W20260812 11:11:00.532899 16370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:00.533298 16370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:00.533456 16370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:00.541093 16370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:00.541244 16370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:00.541400 16370 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:11:00.552114 16370 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.67.keytab
--principal=oryx/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:45777
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=42591
--tserver_master_addrs=127.4.26.126:38963,127.4.26.125:33193,127.4.26.124:38157
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:00.553714 16370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:00.555172 16370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:00.569273 16390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:00.569273 16383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:00.569273 16382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:00.570252 16370 server_base.cc:1034] running on GCE node
I20260812 11:11:00.570935 16370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:00.572002 16370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:00.573263 16370 hybrid_clock.cc:648] HybridClock initialized: now 1786533060573204 us; error 50 us; skew 500 ppm
I20260812 11:11:00.573611 16370 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:00 dist-test-slave-rmhg krb5kdc[14425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533060, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:00.577133 16370 init.cc:377] Logged in from keytab as oryx/127.4.26.67@KRBTEST.COM (short username oryx)
I20260812 11:11:00.578920 16370 webserver.cc:460] Webserver started at http://127.4.26.67:42591/ using document root <none> and password file <none>
I20260812 11:11:00.579710 16370 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:00.579857 16370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:00.586066 16370 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 11:11:00.589263 16401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:00.590771 16370 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:11:00.590970 16370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "ab1fd6437c64499fb788884c45137d6f"
format_stamp: "Formatted at 2026-08-12 11:10:57 on dist-test-slave-rmhg"
server_key: "85a8e5505bc31deac6dcbc4a60d4f4f6"
server_key_iv: "d50a3ebe1625133567562c0423cc0a81"
server_key_version: "encryptionkey@0"
I20260812 11:11:00.592052 16370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:00.605799 16370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:00.610081 16370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:00.610378 16370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:00.611663 16370 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:11:00.613085 16370 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:00.613217 16370 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 11:11:00.613332 16370 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:00.613411 16370 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:00.645421 16370 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:45777
I20260812 11:11:00.645490 16590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:45777 every 8 connection(s)
I20260812 11:11:00.647053 16370 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:11:00.647433 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 16370
Aug 12 11:11:00 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533060, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.124@KRBTEST.COM
Aug 12 11:11:00 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533060, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.125@KRBTEST.COM
I20260812 11:11:00.700107 16599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.650377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:51665 (local address 127.4.26.124:38157)
0812 11:11:00.674370 (+ 23993us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:00.674379 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:00.674407 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:11:00.674486 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:00.674491 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:00.674581 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:00.674712 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:00.678383 (+ 3671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.679604 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.682792 (+ 3188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.683503 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.683605 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.689913 (+ 6308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:00.689921 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:00.689926 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:00.689972 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:00.693810 (+ 3838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.694900 (+ 1090us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.694906 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.694913 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.695108 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.697593 (+ 2485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.697599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.697603 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.697995 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:00.698159 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:00.699372 (+ 1213us) server_negotiation.cc:299] Negotiation successful
0812 11:11:00.699652 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23841,"thread_start_us":25188,"threads_started":1}
I20260812 11:11:00.702554 16600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.655476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:33193 (local address 127.4.26.67:47679)
0812 11:11:00.675376 (+ 19900us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:00.675394 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:00.675509 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:00.676110 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:00.676125 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:00.676935 (+ 810us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:00.678126 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.678158 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.679824 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.679830 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.682573 (+ 2743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.682590 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.683980 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.683988 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.684410 (+ 422us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.685399 (+ 989us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:00.685418 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:00.690838 (+ 5420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:00.696024 (+ 5186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:00.696029 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:00.696032 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:00.696663 (+ 631us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:00.697244 (+ 581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:00.697250 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:00.697253 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:00.697420 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:00.698149 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:00.698159 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:00.698699 (+ 540us) client_negotiation.cc:769] Sending connection context
0812 11:11:00.699031 (+ 332us) client_negotiation.cc:240] Negotiation successful
0812 11:11:00.699938 (+ 907us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19785,"mutex_wait_us":319,"spinlock_wait_cycles":32256,"thread_start_us":13208,"threads_started":1}
I20260812 11:11:00.704149 16602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.651066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:38157 (local address 127.4.26.67:51665)
0812 11:11:00.669226 (+ 18160us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:00.669304 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:00.672140 (+ 2836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:00.676108 (+ 3968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:00.676123 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:00.676918 (+ 795us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:00.678126 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.678158 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.679824 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.679830 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.682568 (+ 2738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.682590 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.683980 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.683988 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.684408 (+ 420us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.685373 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:00.685410 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:00.689549 (+ 4139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:00.694029 (+ 4480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:00.694041 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:00.694065 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:00.694732 (+ 667us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:00.695253 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:00.695258 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:00.695262 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:00.695551 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:00.698223 (+ 2672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:00.698228 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:00.698699 (+ 471us) client_negotiation.cc:769] Sending connection context
0812 11:11:00.699034 (+ 335us) client_negotiation.cc:240] Negotiation successful
0812 11:11:00.703679 (+ 4645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17777,"mutex_wait_us":2928,"spinlock_wait_cycles":12672,"thread_start_us":23829,"threads_started":1}
Aug 12 11:11:00 dist-test-slave-rmhg krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533060, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM
I20260812 11:11:00.705606 16603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.656073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:47679 (local address 127.4.26.125:33193)
0812 11:11:00.673067 (+ 16994us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:00.673074 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:00.675510 (+ 2436us) server_negotiation.cc:407] Connection header received
0812 11:11:00.675603 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:00.675609 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:00.675711 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:00.677065 (+ 1354us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:00.678376 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.679606 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.682787 (+ 3181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.683471 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.683620 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.692035 (+ 8415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:00.692043 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:00.692048 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:00.692096 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:00.695836 (+ 3740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.696894 (+ 1058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.696900 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.696904 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.697080 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.697579 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.697584 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.697588 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.697973 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:00.703866 (+ 5893us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:00.704032 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 11:11:00.705229 (+ 1197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16826,"thread_start_us":16698,"threads_started":1}
I20260812 11:11:00.706140 16592 heartbeater.cc:347] Connected to a master server at 127.4.26.124:38157
I20260812 11:11:00.706508 16592 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:00.707504 16592 heartbeater.cc:511] Master 127.4.26.124:38157 requested a full tablet report, sending...
I20260812 11:11:00.709718 15797 ts_manager.cc:194] Registered new tserver with Master: ab1fd6437c64499fb788884c45137d6f (127.4.26.67:45777)
I20260812 11:11:00.711814 16596 heartbeater.cc:347] Connected to a master server at 127.4.26.125:33193
I20260812 11:11:00.711968 16596 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:00.712464 16596 heartbeater.cc:511] Master 127.4.26.125:33193 requested a full tablet report, sending...
I20260812 11:11:00.712515 16611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.679508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39614 (local address 127.4.26.124:38157)
0812 11:11:00.691698 (+ 12190us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:00.691707 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:00.691734 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:11:00.691801 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:00.691806 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:00.691886 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:00.691993 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:00.694703 (+ 2710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.696042 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.698135 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.698738 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.698867 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.703023 (+ 4156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:00.703031 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:00.703035 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:00.703117 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:00.707619 (+ 4502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.709225 (+ 1606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.709230 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.709234 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.709411 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.709922 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.709927 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.709929 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.710307 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:00.710754 (+ 447us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:00.711859 (+ 1105us) server_negotiation.cc:299] Negotiation successful
0812 11:11:00.712127 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12050,"thread_start_us":11921,"threads_started":1}
I20260812 11:11:00.712646 16598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.650306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:36409 (local address 127.4.26.126:38963)
0812 11:11:00.677915 (+ 27609us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:00.677920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:00.677938 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:11:00.677992 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:00.677996 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:00.678056 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:00.678165 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:00.693075 (+ 14910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.695034 (+ 1959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.700224 (+ 5190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.700787 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.700916 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.705451 (+ 4535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:00.705469 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:00.705474 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:00.705517 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:00.708914 (+ 3397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.709802 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.709807 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.709810 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.709983 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.710457 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.710462 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.710465 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.710826 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:00.710976 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:00.712006 (+ 1030us) server_negotiation.cc:299] Negotiation successful
0812 11:11:00.712265 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27497,"thread_start_us":27964,"threads_started":1}
I20260812 11:11:00.713532 16601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.651066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.67:36409)
0812 11:11:00.673389 (+ 22323us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:00.673414 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:00.673583 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:00.678225 (+ 4642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:00.678230 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:00.678794 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:00.679101 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.679116 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.695689 (+ 16573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.695695 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.697371 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.697391 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.701044 (+ 3653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.701053 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.701299 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.701955 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:00.701988 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:00.705033 (+ 3045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:00.709100 (+ 4067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:00.709106 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:00.709110 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:00.709644 (+ 534us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:00.710123 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:00.710128 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:00.710131 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:00.710319 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:00.711060 (+ 741us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:00.711065 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:00.711227 (+ 162us) client_negotiation.cc:769] Sending connection context
0812 11:11:00.711379 (+ 152us) client_negotiation.cc:240] Negotiation successful
0812 11:11:00.711690 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22117,"mutex_wait_us":30,"spinlock_wait_cycles":122240,"thread_start_us":22430,"threads_started":1}
I20260812 11:11:00.714133 15489 ts_manager.cc:194] Registered new tserver with Master: ab1fd6437c64499fb788884c45137d6f (127.4.26.67:45777)
I20260812 11:11:00.715692 16594 heartbeater.cc:347] Connected to a master server at 127.4.26.126:38963
I20260812 11:11:00.715845 16594 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:00.716338 16594 heartbeater.cc:511] Master 127.4.26.126:38963 requested a full tablet report, sending...
I20260812 11:11:00.717406 14509 ts_manager.cc:194] Re-registered known tserver with Master: ab1fd6437c64499fb788884c45137d6f (127.4.26.67:45777)
I20260812 11:11:00.718639 14509 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:36409
I20260812 11:11:00.728641 16618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.680888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37280 (local address 127.4.26.125:33193)
0812 11:11:00.707111 (+ 26223us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:00.707117 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:00.709719 (+ 2602us) server_negotiation.cc:407] Connection header received
0812 11:11:00.709790 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:00.709795 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:00.709873 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:00.709973 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:00.713652 (+ 3679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.714754 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.717015 (+ 2261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.717539 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.717664 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.722098 (+ 4434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:00.722106 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:00.722109 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:00.722149 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:00.725377 (+ 3228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.726220 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.726226 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.726230 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.726404 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.726826 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.726831 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.726834 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.727205 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:00.727431 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:00.727968 (+ 537us) server_negotiation.cc:299] Negotiation successful
0812 11:11:00.728220 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26078,"thread_start_us":26232,"threads_started":1}
I20260812 11:11:00.730351 16615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.680184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59110 (local address 127.4.26.126:38963)
0812 11:11:00.691292 (+ 11108us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:00.691299 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:00.708622 (+ 17323us) server_negotiation.cc:407] Connection header received
0812 11:11:00.708791 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:00.708796 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:00.708879 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:00.708982 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:00.713523 (+ 4541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.714721 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.717822 (+ 3101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.718621 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.718739 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.723830 (+ 5091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:00.723837 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:00.723842 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:00.723889 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:00.727139 (+ 3250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.728013 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.728019 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.728022 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.728184 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:00.728549 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:00.728555 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:00.728558 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:00.728935 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:00.729328 (+ 393us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:00.729708 (+ 380us) server_negotiation.cc:299] Negotiation successful
0812 11:11:00.729965 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":10975,"thread_start_us":10841,"threads_started":1}
I20260812 11:11:00.734712 14509 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59110:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:11:00.743000 14509 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:11:00.782692 16649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.769357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:40653 (local address 127.0.0.1:56228)
0812 11:11:00.771538 (+ 2181us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:00.771558 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:00.771704 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:00.774388 (+ 2684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:00.774393 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:00.774420 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:00.775010 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.775035 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.776984 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.776990 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.779358 (+ 2368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.779376 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.781680 (+ 2304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.781687 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.781874 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.781917 (+ 43us) client_negotiation.cc:769] Sending connection context
0812 11:11:00.782005 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 11:11:00.782171 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2033,"mutex_wait_us":63,"thread_start_us":2593,"threads_started":1}
I20260812 11:11:00.784094 16651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.770149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56228 (local address 127.4.26.66:40653)
0812 11:11:00.773821 (+ 3672us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:00.773830 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:00.773859 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:11:00.773948 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:00.773954 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:00.774179 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:00.774383 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:00.775272 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.776769 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.779581 (+ 2812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.781401 (+ 1820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.783209 (+ 1808us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.783482 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:00.783572 (+ 90us) server_negotiation.cc:299] Negotiation successful
0812 11:11:00.783775 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3525,"thread_start_us":3411,"threads_started":1}
I20260812 11:11:00.784657 16655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.771797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:37083 (local address 127.0.0.1:52020)
0812 11:11:00.775531 (+ 3734us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:00.775547 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:00.775667 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:00.776580 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:00.776585 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:00.776611 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:00.777222 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.777236 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.779357 (+ 2121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.779363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.781385 (+ 2022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.781408 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.783712 (+ 2304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.783719 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.783918 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.783955 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:11:00.784038 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 11:11:00.784214 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3623,"mutex_wait_us":29,"thread_start_us":3408,"threads_started":1}
I20260812 11:11:00.784986 16656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.772394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52020 (local address 127.4.26.65:37083)
0812 11:11:00.773072 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:00.773084 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:00.775687 (+ 2603us) server_negotiation.cc:407] Connection header received
0812 11:11:00.775813 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:00.775822 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:00.776115 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:00.776331 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:00.777453 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.779141 (+ 1688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.781586 (+ 2445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.783481 (+ 1895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.783631 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.783857 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:00.784134 (+ 277us) server_negotiation.cc:299] Negotiation successful
0812 11:11:00.784459 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":306,"threads_started":1}
I20260812 11:11:00.785328 16648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.769769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:45777 (local address 127.0.0.1:33520)
0812 11:11:00.772237 (+ 2468us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:00.772256 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:00.773222 (+ 966us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:00.774530 (+ 1308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:00.774539 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:00.774608 (+ 69us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:00.775150 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.775163 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.778233 (+ 3070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.778239 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.780361 (+ 2122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:00.780380 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.784262 (+ 3882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.784269 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:00.784480 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.784516 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:11:00.784631 (+ 115us) client_negotiation.cc:240] Negotiation successful
0812 11:11:00.784787 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2321,"mutex_wait_us":27,"spinlock_wait_cycles":1792,"thread_start_us":1695,"threads_started":1}
I20260812 11:11:00.786302 16653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:00.771220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33520 (local address 127.4.26.67:45777)
0812 11:11:00.773854 (+ 2634us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:00.773864 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:00.773899 (+ 35us) server_negotiation.cc:407] Connection header received
0812 11:11:00.774011 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:00.774019 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:00.774277 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:00.774714 (+ 437us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:00.775805 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.778088 (+ 2283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.781316 (+ 3228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:00.783716 (+ 2400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:00.783856 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:00.784091 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:00.785724 (+ 1633us) server_negotiation.cc:299] Negotiation successful
0812 11:11:00.785926 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2446,"thread_start_us":2241,"threads_started":1}
I20260812 11:11:00.788859 15980 tablet_service.cc:1467] Processing CreateTablet for tablet 57273b31f5ef4cbb94551bb83f0a77c5 (DEFAULT_TABLE table=test-table [id=8645fb9d6d894baf97529bec3175eb02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:00.790086 16487 tablet_service.cc:1467] Processing CreateTablet for tablet 57273b31f5ef4cbb94551bb83f0a77c5 (DEFAULT_TABLE table=test-table [id=8645fb9d6d894baf97529bec3175eb02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:00.790143 16233 tablet_service.cc:1467] Processing CreateTablet for tablet 57273b31f5ef4cbb94551bb83f0a77c5 (DEFAULT_TABLE table=test-table [id=8645fb9d6d894baf97529bec3175eb02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:00.790793 15980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57273b31f5ef4cbb94551bb83f0a77c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:00.791505 16487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57273b31f5ef4cbb94551bb83f0a77c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:00.791504 16233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57273b31f5ef4cbb94551bb83f0a77c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:00.807927 16657 tablet_bootstrap.cc:492] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d: Bootstrap starting.
I20260812 11:11:00.812860 16657 tablet_bootstrap.cc:654] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:00.814096 16657 log.cc:824] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:11:00.817405 16658 tablet_bootstrap.cc:492] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f: Bootstrap starting.
I20260812 11:11:00.819710 16657 tablet_bootstrap.cc:492] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d: No bootstrap required, opened a new log
I20260812 11:11:00.820218 16657 ts_tablet_manager.cc:1397] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.005s
I20260812 11:11:00.822971 16658 tablet_bootstrap.cc:654] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:00.824815 16658 log.cc:824] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:11:00.829293 16662 tablet_bootstrap.cc:492] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072: Bootstrap starting.
I20260812 11:11:00.832805 16657 raft_consensus.cc:348] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:00.833571 16657 raft_consensus.cc:374] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:00.833755 16657 raft_consensus.cc:729] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50c81efc0e36481abeda1faaad9fc87d, State: Initialized, Role: FOLLOWER
I20260812 11:11:00.834753 16657 consensus_queue.cc:260] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:00.835239 16658 tablet_bootstrap.cc:492] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f: No bootstrap required, opened a new log
I20260812 11:11:00.835601 16658 ts_tablet_manager.cc:1397] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.007s
I20260812 11:11:00.836272 16662 tablet_bootstrap.cc:654] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:00.837762 16662 log.cc:824] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072: Log is configured to *not* fsync() on all Append() calls
I20260812 11:11:00.843757 16657 ts_tablet_manager.cc:1428] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d: Time spent starting tablet: real 0.023s user 0.011s sys 0.009s
I20260812 11:11:00.847294 16658 raft_consensus.cc:348] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:00.847867 16658 raft_consensus.cc:374] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:00.847925 16662 tablet_bootstrap.cc:492] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072: No bootstrap required, opened a new log
I20260812 11:11:00.847977 16658 raft_consensus.cc:729] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab1fd6437c64499fb788884c45137d6f, State: Initialized, Role: FOLLOWER
I20260812 11:11:00.848258 16662 ts_tablet_manager.cc:1397] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.005s
I20260812 11:11:00.848860 16658 consensus_queue.cc:260] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
W20260812 11:11:00.854554 16092 tablet.cc:2369] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:11:00.857499 16658 ts_tablet_manager.cc:1428] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f: Time spent starting tablet: real 0.022s user 0.016s sys 0.007s
I20260812 11:11:00.859315 16594 heartbeater.cc:503] Master 127.4.26.126:38963 was elected leader, sending a full tablet report...
I20260812 11:11:00.864126 16662 raft_consensus.cc:348] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:00.864714 16662 raft_consensus.cc:374] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:00.864838 16662 raft_consensus.cc:729] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4167a41432a476688a1acac83242072, State: Initialized, Role: FOLLOWER
I20260812 11:11:00.865629 16662 consensus_queue.cc:260] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:00.866843 16351 heartbeater.cc:503] Master 127.4.26.126:38963 was elected leader, sending a full tablet report...
I20260812 11:11:00.870728 16662 ts_tablet_manager.cc:1428] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072: Time spent starting tablet: real 0.022s user 0.007s sys 0.008s
W20260812 11:11:00.927968 16605 tablet.cc:2369] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:11:01.002562 16354 tablet.cc:2369] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:11:01.022512 16667 raft_consensus.cc:482] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:11:01.022912 16667 raft_consensus.cc:504] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:01.025390 16667 leader_election.cc:288] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4167a41432a476688a1acac83242072 (127.4.26.66:40653), 50c81efc0e36481abeda1faaad9fc87d (127.4.26.65:37083)
I20260812 11:11:01.032068 16651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:01.026312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:57317 (local address 127.4.26.66:40653)
0812 11:11:01.026524 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:01.026530 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:01.026547 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:11:01.026615 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:01.026620 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:01.026676 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:01.026754 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:01.027222 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.028258 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.030051 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.031055 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.031185 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:01.031283 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:01.031662 (+ 379us) server_negotiation.cc:299] Negotiation successful
0812 11:11:01.031803 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:11:01.032122 16601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:01.025591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:40653 (local address 127.4.26.67:57317)
0812 11:11:01.025799 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:01.025829 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:01.025985 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:01.026793 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:01.026798 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:01.026823 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:01.026998 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:01.027011 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.028390 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.028395 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:01.029887 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:01.029900 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.031228 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.031234 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:01.031469 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:01.031506 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:11:01.031618 (+ 112us) client_negotiation.cc:240] Negotiation successful
0812 11:11:01.031774 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":54}
I20260812 11:11:01.032753 16602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:01.025598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:37083 (local address 127.4.26.67:42289)
0812 11:11:01.025980 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:01.025999 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:01.026141 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:01.026518 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:01.026524 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:01.026554 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:01.026775 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:01.026787 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.028268 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.028274 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:01.030452 (+ 2178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:01.030469 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.032002 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.032008 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:01.032229 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:01.032263 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:11:01.032361 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 11:11:01.032484 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"mutex_wait_us":250}
I20260812 11:11:01.032835 16656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:01.025871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:42289 (local address 127.4.26.65:37083)
0812 11:11:01.026073 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:01.026079 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:01.026103 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:11:01.026303 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:01.026307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:01.026376 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:01.026473 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:01.026935 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.028118 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.030638 (+ 2520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.031683 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.031809 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:01.031904 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:01.032423 (+ 519us) server_negotiation.cc:299] Negotiation successful
0812 11:11:01.032578 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 11:11:01.033677 16268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57273b31f5ef4cbb94551bb83f0a77c5" candidate_uuid: "ab1fd6437c64499fb788884c45137d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4167a41432a476688a1acac83242072" is_pre_election: true
I20260812 11:11:01.034036 16011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57273b31f5ef4cbb94551bb83f0a77c5" candidate_uuid: "ab1fd6437c64499fb788884c45137d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50c81efc0e36481abeda1faaad9fc87d" is_pre_election: true
I20260812 11:11:01.034198 16268 raft_consensus.cc:2454] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab1fd6437c64499fb788884c45137d6f in term 0.
I20260812 11:11:01.034585 16011 raft_consensus.cc:2454] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab1fd6437c64499fb788884c45137d6f in term 0.
I20260812 11:11:01.034849 16402 leader_election.cc:302] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab1fd6437c64499fb788884c45137d6f, e4167a41432a476688a1acac83242072; no voters:
I20260812 11:11:01.035311 16667 raft_consensus.cc:2781] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:11:01.035486 16667 raft_consensus.cc:482] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:11:01.035585 16667 raft_consensus.cc:3037] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:01.039113 16667 raft_consensus.cc:504] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:01.040021 16667 leader_election.cc:288] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [CANDIDATE]: Term 1 election: Requested vote from peers e4167a41432a476688a1acac83242072 (127.4.26.66:40653), 50c81efc0e36481abeda1faaad9fc87d (127.4.26.65:37083)
I20260812 11:11:01.040692 16268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57273b31f5ef4cbb94551bb83f0a77c5" candidate_uuid: "ab1fd6437c64499fb788884c45137d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4167a41432a476688a1acac83242072"
I20260812 11:11:01.040714 16011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57273b31f5ef4cbb94551bb83f0a77c5" candidate_uuid: "ab1fd6437c64499fb788884c45137d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50c81efc0e36481abeda1faaad9fc87d"
I20260812 11:11:01.040957 16011 raft_consensus.cc:3037] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:01.040967 16268 raft_consensus.cc:3037] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:01.043413 16011 raft_consensus.cc:2454] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab1fd6437c64499fb788884c45137d6f in term 1.
I20260812 11:11:01.043964 16404 leader_election.cc:302] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50c81efc0e36481abeda1faaad9fc87d, ab1fd6437c64499fb788884c45137d6f; no voters:
I20260812 11:11:01.044313 16667 raft_consensus.cc:2781] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:11:01.044716 16268 raft_consensus.cc:2454] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab1fd6437c64499fb788884c45137d6f in term 1.
I20260812 11:11:01.045023 16667 raft_consensus.cc:686] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [term 1 LEADER]: Becoming Leader. State: Replica: ab1fd6437c64499fb788884c45137d6f, State: Running, Role: LEADER
I20260812 11:11:01.046036 16667 consensus_queue.cc:237] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:01.060308 14508 catalog_manager.cc:5495] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f reported cstate change: term changed from 0 to 1, leader changed from <none> to ab1fd6437c64499fb788884c45137d6f (127.4.26.67). New cstate: current_term: 1 leader_uuid: "ab1fd6437c64499fb788884c45137d6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } health_report { overall_health: UNKNOWN } } }
I20260812 11:11:01.086831 16653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:01.079949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33536 (local address 127.4.26.67:45777)
0812 11:11:01.080181 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:01.080187 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:01.080208 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:11:01.080460 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:01.080464 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:01.080571 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:01.080732 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:11:01.081205 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.082685 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.084109 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.084792 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.084952 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:01.085550 (+ 598us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:11:01.086303 (+ 753us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:11:01.086439 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:01.086542 (+ 103us) server_negotiation.cc:299] Negotiation successful
0812 11:11:01.086622 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 11:11:01.095960 16268 raft_consensus.cc:1261] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072 [term 1 FOLLOWER]: Refusing update from remote peer ab1fd6437c64499fb788884c45137d6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:11:01.095969 16011 raft_consensus.cc:1261] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d [term 1 FOLLOWER]: Refusing update from remote peer ab1fd6437c64499fb788884c45137d6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:11:01.097101 16670 consensus_queue.cc:1035] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:11:01.097661 16667 consensus_queue.cc:1035] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:11:01.115834 16677 mvcc.cc:205] Tried to move back new op lower bound from 7317639418237464576 to 7317639418048798720. Current Snapshot: MvccSnapshot[applied={T|T < 7317639418237464576}]
I20260812 11:11:01.117342 16682 mvcc.cc:205] Tried to move back new op lower bound from 7317639418237464576 to 7317639418048798720. Current Snapshot: MvccSnapshot[applied={T|T < 7317639418237464576}]
I20260812 11:11:01.134238 14509 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:11:01.134622 14509 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:11:01.141322 14509 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe3328dc118a4cae86180c14ef0d4d64: Sending DeleteTablet for 3 replicas of tablet 57273b31f5ef4cbb94551bb83f0a77c5
I20260812 11:11:01.143175 16233 tablet_service.cc:1514] Processing DeleteTablet for tablet 57273b31f5ef4cbb94551bb83f0a77c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:01 UTC) from {username='oryx', principal='oryx/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:56228
I20260812 11:11:01.143774 16487 tablet_service.cc:1514] Processing DeleteTablet for tablet 57273b31f5ef4cbb94551bb83f0a77c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:01 UTC) from {username='oryx', principal='oryx/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:33520
I20260812 11:11:01.145025 15980 tablet_service.cc:1514] Processing DeleteTablet for tablet 57273b31f5ef4cbb94551bb83f0a77c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:01 UTC) from {username='oryx', principal='oryx/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:52020
I20260812 11:11:01.154359 16692 tablet_replica.cc:330] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072: stopping tablet replica
I20260812 11:11:01.154971 16692 raft_consensus.cc:2229] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:11:01.155616 16692 raft_consensus.cc:2258] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:01.156096 16695 tablet_replica.cc:330] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d: stopping tablet replica
I20260812 11:11:01.156582 16695 raft_consensus.cc:2229] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:11:01.157110 16695 raft_consensus.cc:2258] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:01.158293 16692 ts_tablet_manager.cc:1905] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:01.159667 16695 ts_tablet_manager.cc:1905] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:01.166672 16692 ts_tablet_manager.cc:1918] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:11:01.166896 16692 log.cc:1196] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/57273b31f5ef4cbb94551bb83f0a77c5
I20260812 11:11:01.167018 16695 ts_tablet_manager.cc:1918] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:11:01.167234 16695 log.cc:1196] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/57273b31f5ef4cbb94551bb83f0a77c5
I20260812 11:11:01.167558 16692 ts_tablet_manager.cc:1939] T 57273b31f5ef4cbb94551bb83f0a77c5 P e4167a41432a476688a1acac83242072: Deleting consensus metadata
I20260812 11:11:01.167829 16695 ts_tablet_manager.cc:1939] T 57273b31f5ef4cbb94551bb83f0a77c5 P 50c81efc0e36481abeda1faaad9fc87d: Deleting consensus metadata
I20260812 11:11:01.169318 16693 tablet_replica.cc:330] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f: stopping tablet replica
I20260812 11:11:01.169811 14489 catalog_manager.cc:4841] TS 50c81efc0e36481abeda1faaad9fc87d (127.4.26.65:37083): tablet 57273b31f5ef4cbb94551bb83f0a77c5 (table test-table [id=8645fb9d6d894baf97529bec3175eb02]) successfully deleted
I20260812 11:11:01.169836 14485 catalog_manager.cc:4841] TS e4167a41432a476688a1acac83242072 (127.4.26.66:40653): tablet 57273b31f5ef4cbb94551bb83f0a77c5 (table test-table [id=8645fb9d6d894baf97529bec3175eb02]) successfully deleted
I20260812 11:11:01.170707 16693 raft_consensus.cc:2229] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:11:01.171325 16693 raft_consensus.cc:2258] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:01.174141 16693 ts_tablet_manager.cc:1905] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:01.176929 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 14451
I20260812 11:11:01.179003 14551 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:01.197247 16618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:01.146038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37296 (local address 127.4.26.125:33193)
0812 11:11:01.146210 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:01.146217 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:01.172272 (+ 26055us) server_negotiation.cc:407] Connection header received
0812 11:11:01.172698 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:01.172704 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:01.172802 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:01.172888 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:01.176554 (+ 3666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.177922 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.181017 (+ 3095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.181945 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.182074 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:01.188110 (+ 6036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:01.188120 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:01.188125 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:01.188180 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:01.192571 (+ 4391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:01.193800 (+ 1229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:01.193808 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:01.193812 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:01.194019 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:01.194618 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:01.194625 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:01.194628 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:01.195158 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:01.195435 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:01.196465 (+ 1030us) server_negotiation.cc:299] Negotiation successful
0812 11:11:01.196832 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 11:11:01.199697 16693 ts_tablet_manager.cc:1918] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:11:01.200209 16693 log.cc:1196] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/57273b31f5ef4cbb94551bb83f0a77c5
I20260812 11:11:01.201215 16693 ts_tablet_manager.cc:1939] T 57273b31f5ef4cbb94551bb83f0a77c5 P ab1fd6437c64499fb788884c45137d6f: Deleting consensus metadata
I20260812 11:11:01.225240 16611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:01.179411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39624 (local address 127.4.26.124:38157)
0812 11:11:01.179671 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:01.179678 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:01.198502 (+ 18824us) server_negotiation.cc:407] Connection header received
0812 11:11:01.198778 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:01.198784 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:01.198873 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:01.198944 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:01.201925 (+ 2981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.203257 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.206261 (+ 3004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.207158 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.207316 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:01.214560 (+ 7244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:01.214572 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:01.214577 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:01.214653 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:01.220060 (+ 5407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:01.221734 (+ 1674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:01.221742 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:01.221746 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:01.222025 (+ 279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:01.222687 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:01.222693 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:01.222697 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:01.223174 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:01.223521 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:01.224450 (+ 929us) server_negotiation.cc:299] Negotiation successful
0812 11:11:01.224790 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:11:01.333981 14489 catalog_manager.cc:4841] TS ab1fd6437c64499fb788884c45137d6f (127.4.26.67:45777): tablet 57273b31f5ef4cbb94551bb83f0a77c5 (table test-table [id=8645fb9d6d894baf97529bec3175eb02]) successfully deleted
I20260812 11:11:01.334793 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 14451
I20260812 11:11:01.397684 16618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:01.369754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37312 (local address 127.4.26.125:33193)
0812 11:11:01.370009 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:01.370016 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:01.375473 (+ 5457us) server_negotiation.cc:407] Connection header received
0812 11:11:01.375823 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:01.375829 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:01.375927 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:01.376052 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:01.379078 (+ 3026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.380658 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.382966 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.383554 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.383687 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:01.389051 (+ 5364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:01.389062 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:01.389068 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:01.389122 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:01.393949 (+ 4827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:01.394906 (+ 957us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:01.394913 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:01.394917 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:01.395164 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:01.395710 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:01.395716 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:01.395720 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:01.396209 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:01.396572 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:01.396956 (+ 384us) server_negotiation.cc:299] Negotiation successful
0812 11:11:01.397232 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 11:11:01.398012 16611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:01.370660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39638 (local address 127.4.26.124:38157)
0812 11:11:01.370847 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:01.370852 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:01.376397 (+ 5545us) server_negotiation.cc:407] Connection header received
0812 11:11:01.376726 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:01.376732 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:01.376850 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:01.376968 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:01.380524 (+ 3556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.382028 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.384684 (+ 2656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:01.385665 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:01.385821 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:01.389582 (+ 3761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:01.389589 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:01.389592 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:01.389637 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:01.393484 (+ 3847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:01.394369 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:01.394376 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:01.394380 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:01.394569 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:01.395024 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:01.395028 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:01.395031 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:01.395530 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:01.395852 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:01.397248 (+ 1396us) server_negotiation.cc:299] Negotiation successful
0812 11:11:01.397496 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260812 11:11:02.120764 16709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:02.119973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.67:54883)
0812 11:11:02.120478 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:02.120604 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":276,"threads_started":1}
W20260812 11:11:02.121299 16594 heartbeater.cc:644] Failed to heartbeat to 127.4.26.126:38963 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
I20260812 11:11:02.124567 16710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:02.123734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.65:57689)
0812 11:11:02.124191 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:02.124337 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":235,"threads_started":1}
W20260812 11:11:02.125130 16089 heartbeater.cc:644] Failed to heartbeat to 127.4.26.126:38963 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
I20260812 11:11:02.128999 16712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:02.128156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.66:37263)
0812 11:11:02.128618 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:02.128781 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":263,"threads_started":1}
W20260812 11:11:02.129666 16351 heartbeater.cc:644] Failed to heartbeat to 127.4.26.126:38963 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
I20260812 11:11:02.642935 16715 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe3328dc118a4cae86180c14ef0d4d64)
I20260812 11:11:02.643199 16715 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } }
I20260812 11:11:02.643321 16717 raft_consensus.cc:482] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe3328dc118a4cae86180c14ef0d4d64)
I20260812 11:11:02.643600 16717 raft_consensus.cc:504] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } }
I20260812 11:11:02.644114 16715 leader_election.cc:288] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe3328dc118a4cae86180c14ef0d4d64 (127.4.26.126:38963), 034e13bde73543c6871b5ecf9b75c914 (127.4.26.124:38157)
I20260812 11:11:02.652223 16717 leader_election.cc:288] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe3328dc118a4cae86180c14ef0d4d64 (127.4.26.126:38963), 3507be9fe2f4400999bd423b26580f0c (127.4.26.125:33193)
I20260812 11:11:02.652331 16720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:02.644315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59520)
0812 11:11:02.651777 (+ 7462us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:02.652027 (+ 250us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7331,"threads_started":1}
I20260812 11:11:02.652639 16726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:02.645467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59530)
0812 11:11:02.652152 (+ 6685us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:02.652385 (+ 233us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6545,"threads_started":1}
W20260812 11:11:02.654098 15770 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
W20260812 11:11:02.654312 15462 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
I20260812 11:11:02.660887 16720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:02.644351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:38157 (local address 127.0.0.1:39648)
0812 11:11:02.652584 (+ 8233us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:02.652607 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:02.652881 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:02.653490 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:02.653495 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:02.653527 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:02.653819 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:02.653833 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:02.655421 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:02.655431 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:02.657996 (+ 2565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:02.658017 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:02.659920 (+ 1903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:02.659926 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:02.660178 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:02.660219 (+ 41us) client_negotiation.cc:769] Sending connection context
0812 11:11:02.660307 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 11:11:02.660462 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8115,"mutex_wait_us":1,"thread_start_us":7066,"threads_started":1}
I20260812 11:11:02.662895 16728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:02.653712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37320 (local address 127.4.26.125:33193)
0812 11:11:02.654374 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:02.654379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:02.654396 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:11:02.654460 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:02.654465 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:02.654533 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:02.655143 (+ 610us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:02.655343 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:02.657056 (+ 1713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:02.659794 (+ 2738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:02.661097 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:02.662184 (+ 1087us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:02.662301 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:02.662359 (+ 58us) server_negotiation.cc:299] Negotiation successful
0812 11:11:02.662511 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":287,"threads_started":1}
I20260812 11:11:02.662945 16726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:02.645994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:33193 (local address 127.0.0.1:37320)
0812 11:11:02.652893 (+ 6899us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:02.652911 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:02.653024 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:02.654716 (+ 1692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:02.654722 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:02.654759 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:02.655001 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:02.655013 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:02.657310 (+ 2297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:02.657317 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:02.659550 (+ 2233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:02.659568 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:02.661352 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:02.661359 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:02.661623 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:02.661660 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:11:02.661740 (+ 80us) client_negotiation.cc:240] Negotiation successful
0812 11:11:02.661911 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6812,"mutex_wait_us":5,"thread_start_us":5865,"threads_started":1}
I20260812 11:11:02.662951 16720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:02.662450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59540)
0812 11:11:02.662611 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:02.662719 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 11:11:02.663517 15462 leader_election.cc:334] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe3328dc118a4cae86180c14ef0d4d64 (127.4.26.126:38963): Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
I20260812 11:11:02.663786 16721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:02.644732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39648 (local address 127.4.26.124:38157)
0812 11:11:02.651153 (+ 6421us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:02.651161 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:02.652736 (+ 1575us) server_negotiation.cc:407] Connection header received
0812 11:11:02.653055 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:02.653061 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:02.653128 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:02.653234 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:02.654001 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:02.655257 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:02.658307 (+ 3050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:02.659727 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:02.662103 (+ 2376us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:02.663171 (+ 1068us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:02.663237 (+ 66us) server_negotiation.cc:299] Negotiation successful
0812 11:11:02.663413 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":785,"server-negotiator.queue_time_us":6219,"thread_start_us":6007,"threads_started":1}
I20260812 11:11:02.664199 16726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:02.663823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59556)
0812 11:11:02.663974 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:02.664061 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 11:11:02.664278 15507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "034e13bde73543c6871b5ecf9b75c914" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3507be9fe2f4400999bd423b26580f0c" is_pre_election: true
I20260812 11:11:02.664381 15811 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3507be9fe2f4400999bd423b26580f0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "034e13bde73543c6871b5ecf9b75c914" is_pre_election: true
W20260812 11:11:02.664510 15770 leader_election.cc:334] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe3328dc118a4cae86180c14ef0d4d64 (127.4.26.126:38963): Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
I20260812 11:11:02.664649 15507 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034e13bde73543c6871b5ecf9b75c914 in term 1.
I20260812 11:11:02.664793 15811 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3507be9fe2f4400999bd423b26580f0c in term 1.
I20260812 11:11:02.665252 15772 leader_election.cc:302] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 034e13bde73543c6871b5ecf9b75c914, 3507be9fe2f4400999bd423b26580f0c; no voters: fe3328dc118a4cae86180c14ef0d4d64
I20260812 11:11:02.665274 15468 leader_election.cc:302] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 034e13bde73543c6871b5ecf9b75c914, 3507be9fe2f4400999bd423b26580f0c; no voters: fe3328dc118a4cae86180c14ef0d4d64
I20260812 11:11:02.665628 16715 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 11:11:02.665647 16717 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 11:11:02.665750 16715 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe3328dc118a4cae86180c14ef0d4d64)
I20260812 11:11:02.665789 16717 raft_consensus.cc:482] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe3328dc118a4cae86180c14ef0d4d64)
I20260812 11:11:02.665848 16715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:11:02.665897 16717 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:11:02.668300 16715 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } }
I20260812 11:11:02.668314 16717 raft_consensus.cc:504] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } }
I20260812 11:11:02.669034 16715 leader_election.cc:288] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [CANDIDATE]: Term 2 election: Requested vote from peers fe3328dc118a4cae86180c14ef0d4d64 (127.4.26.126:38963), 034e13bde73543c6871b5ecf9b75c914 (127.4.26.124:38157)
I20260812 11:11:02.669282 16717 leader_election.cc:288] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [CANDIDATE]: Term 2 election: Requested vote from peers fe3328dc118a4cae86180c14ef0d4d64 (127.4.26.126:38963), 3507be9fe2f4400999bd423b26580f0c (127.4.26.125:33193)
I20260812 11:11:02.669683 16720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:02.669269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59562)
0812 11:11:02.669425 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:02.669523 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260812 11:11:02.669855 16726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:02.669329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59576)
0812 11:11:02.669501 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:02.669606 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 11:11:02.669924 15811 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3507be9fe2f4400999bd423b26580f0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "034e13bde73543c6871b5ecf9b75c914"
I20260812 11:11:02.670468 15811 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3507be9fe2f4400999bd423b26580f0c in current term 2: Already voted for candidate 034e13bde73543c6871b5ecf9b75c914 in this term.
I20260812 11:11:02.670537 15507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "034e13bde73543c6871b5ecf9b75c914" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3507be9fe2f4400999bd423b26580f0c"
I20260812 11:11:02.670924 15507 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 034e13bde73543c6871b5ecf9b75c914 in current term 2: Already voted for candidate 3507be9fe2f4400999bd423b26580f0c in this term.
I20260812 11:11:02.671157 16720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:02.670551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59582)
0812 11:11:02.670826 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:02.670943 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
W20260812 11:11:02.671586 15462 leader_election.cc:334] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe3328dc118a4cae86180c14ef0d4d64 (127.4.26.126:38963): Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
I20260812 11:11:02.671873 15462 leader_election.cc:302] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3507be9fe2f4400999bd423b26580f0c; no voters: 034e13bde73543c6871b5ecf9b75c914, fe3328dc118a4cae86180c14ef0d4d64
I20260812 11:11:02.671967 16726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:02.671334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59594)
0812 11:11:02.671542 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:02.671726 (+ 184us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260812 11:11:02.672204 15770 leader_election.cc:334] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fe3328dc118a4cae86180c14ef0d4d64 (127.4.26.126:38963): Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
I20260812 11:11:02.672228 16715 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 11:11:02.672333 15770 leader_election.cc:302] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 034e13bde73543c6871b5ecf9b75c914; no voters: 3507be9fe2f4400999bd423b26580f0c, fe3328dc118a4cae86180c14ef0d4d64
I20260812 11:11:02.672621 16717 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 11:11:03.123014 16732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:03.122104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.67:37105)
0812 11:11:03.122649 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:03.122765 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":285,"threads_started":1}
I20260812 11:11:03.126658 16737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:03.125855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.65:44721)
0812 11:11:03.126340 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:03.126437 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":256,"threads_started":1}
I20260812 11:11:03.131224 16739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:03.130268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.66:46349)
0812 11:11:03.130878 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:03.130984 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":392,"threads_started":1}
I20260812 11:11:04.124598 16740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.123833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.67:38083)
0812 11:11:04.124317 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.124405 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":257,"threads_started":1}
I20260812 11:11:04.128551 16743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.127565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.65:38839)
0812 11:11:04.128246 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.128366 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":462,"threads_started":1}
I20260812 11:11:04.132920 16744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.132030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.66:57425)
0812 11:11:04.132581 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.132692 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":277,"threads_started":1}
I20260812 11:11:04.774498 16745 raft_consensus.cc:482] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:11:04.774735 16745 raft_consensus.cc:504] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } }
I20260812 11:11:04.775678 16745 leader_election.cc:288] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe3328dc118a4cae86180c14ef0d4d64 (127.4.26.126:38963), 3507be9fe2f4400999bd423b26580f0c (127.4.26.125:33193)
I20260812 11:11:04.776414 15507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "034e13bde73543c6871b5ecf9b75c914" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3507be9fe2f4400999bd423b26580f0c" is_pre_election: true
I20260812 11:11:04.776733 15507 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 034e13bde73543c6871b5ecf9b75c914 in term 2.
I20260812 11:11:04.776832 16746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.775933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59880)
0812 11:11:04.776489 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.776606 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":286,"threads_started":1}
I20260812 11:11:04.777338 15772 leader_election.cc:302] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 034e13bde73543c6871b5ecf9b75c914, 3507be9fe2f4400999bd423b26580f0c; no voters:
I20260812 11:11:04.777657 16745 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 11:11:04.777801 16745 raft_consensus.cc:482] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:11:04.777901 16745 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 2 FOLLOWER]: Advancing to term 3
I20260812 11:11:04.779858 16746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.779350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59882)
0812 11:11:04.779543 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.779675 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 11:11:04.780100 15770 leader_election.cc:334] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fe3328dc118a4cae86180c14ef0d4d64 (127.4.26.126:38963): Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
I20260812 11:11:04.780956 16745 raft_consensus.cc:504] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } }
I20260812 11:11:04.781688 16745 leader_election.cc:288] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [CANDIDATE]: Term 3 election: Requested vote from peers fe3328dc118a4cae86180c14ef0d4d64 (127.4.26.126:38963), 3507be9fe2f4400999bd423b26580f0c (127.4.26.125:33193)
I20260812 11:11:04.782322 15507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "034e13bde73543c6871b5ecf9b75c914" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3507be9fe2f4400999bd423b26580f0c"
I20260812 11:11:04.782433 16746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.781914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59892)
0812 11:11:04.782164 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.782281 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 11:11:04.782562 15507 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 2 FOLLOWER]: Advancing to term 3
I20260812 11:11:04.783540 16746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.783152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59904)
0812 11:11:04.783323 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.783404 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260812 11:11:04.783712 15770 leader_election.cc:334] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer fe3328dc118a4cae86180c14ef0d4d64 (127.4.26.126:38963): Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
I20260812 11:11:04.785189 15507 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 034e13bde73543c6871b5ecf9b75c914 in term 3.
I20260812 11:11:04.785701 15772 leader_election.cc:302] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 034e13bde73543c6871b5ecf9b75c914, 3507be9fe2f4400999bd423b26580f0c; no voters: fe3328dc118a4cae86180c14ef0d4d64
I20260812 11:11:04.786034 16745 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 11:11:04.786522 16745 raft_consensus.cc:686] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [term 3 LEADER]: Becoming Leader. State: Replica: 034e13bde73543c6871b5ecf9b75c914, State: Running, Role: LEADER
I20260812 11:11:04.786926 16745 consensus_queue.cc:237] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } }
I20260812 11:11:04.788702 16749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 034e13bde73543c6871b5ecf9b75c914. Latest consensus state: current_term: 3 leader_uuid: "034e13bde73543c6871b5ecf9b75c914" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } } }
I20260812 11:11:04.789228 16749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: This master's current role is: LEADER
I20260812 11:11:04.789918 16752 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:11:04.793979 16752 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:11:04.794915 16752 catalog_manager.cc:1259] Loaded cluster ID: e5eabb831a3749488b23faef0c1c0891
I20260812 11:11:04.795003 16752 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:11:04.796294 16752 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:11:04.797222 16752 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: Loaded TSK: 0
I20260812 11:11:04.798120 16752 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:11:04.851231 15796 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39638:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:11:04.859333 15796 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:11:04.864178 16746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.863699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59928)
0812 11:11:04.863917 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.864014 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260812 11:11:04.864194 15507 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [term 3 FOLLOWER]: Refusing update from remote peer 034e13bde73543c6871b5ecf9b75c914: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260812 11:11:04.864988 16749 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260812 11:11:04.865370 16746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.864865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59932)
0812 11:11:04.865073 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.865210 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260812 11:11:04.865667 15770 consensus_peers.cc:487] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 -> Peer fe3328dc118a4cae86180c14ef0d4d64 (127.4.26.126:38963): Couldn't send request to peer fe3328dc118a4cae86180c14ef0d4d64. Status: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 11:11:04.868731 16756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 034e13bde73543c6871b5ecf9b75c914. Latest consensus state: current_term: 3 leader_uuid: "034e13bde73543c6871b5ecf9b75c914" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } } }
I20260812 11:11:04.869324 16756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:11:04.870635 16749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "034e13bde73543c6871b5ecf9b75c914" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } } }
I20260812 11:11:04.870976 16749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914 [sys.catalog]: This master's current role is: LEADER
I20260812 11:11:04.871555 16756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "034e13bde73543c6871b5ecf9b75c914" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "fe3328dc118a4cae86180c14ef0d4d64" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 38963 } } peers { permanent_uuid: "3507be9fe2f4400999bd423b26580f0c" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 33193 } attrs { promote: false } } peers { permanent_uuid: "034e13bde73543c6871b5ecf9b75c914" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 38157 } attrs { promote: false } } }
I20260812 11:11:04.871807 16756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3507be9fe2f4400999bd423b26580f0c [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:11:04.890116 16772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.882586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:40653 (local address 127.0.0.1:56244)
0812 11:11:04.883164 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.883180 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:04.883303 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:04.883896 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:04.883900 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:04.883934 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:04.884319 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:04.884328 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:04.885580 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:04.885585 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:04.887813 (+ 2228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:04.887827 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:04.889231 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:04.889238 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:04.889400 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:04.889425 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:11:04.889520 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 11:11:04.889666 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"mutex_wait_us":86,"spinlock_wait_cycles":896,"thread_start_us":312,"threads_started":1}
I20260812 11:11:04.890865 16746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.881078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:45777 (local address 127.0.0.1:33552)
0812 11:11:04.881292 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.881315 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:04.881454 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:04.883827 (+ 2373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:04.883832 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:04.883877 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:04.884254 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:04.884264 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:04.885738 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:04.885743 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:04.888164 (+ 2421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:04.888182 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:04.890061 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:04.890072 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:04.890264 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:04.890301 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:11:04.890374 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 11:11:04.890520 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":114,"spinlock_wait_cycles":13184}
I20260812 11:11:04.890919 16766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.881707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56244 (local address 127.4.26.66:40653)
0812 11:11:04.882459 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:04.882466 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:04.883411 (+ 945us) server_negotiation.cc:407] Connection header received
0812 11:11:04.883511 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:04.883516 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:04.883607 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:04.883706 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:04.884512 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:04.885418 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:04.887992 (+ 2574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:04.888998 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:04.889181 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:04.889302 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:04.889568 (+ 266us) server_negotiation.cc:299] Negotiation successful
0812 11:11:04.889712 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":520,"threads_started":1}
I20260812 11:11:04.891387 16768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.882143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:37083 (local address 127.0.0.1:52022)
0812 11:11:04.882867 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.882889 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:04.883046 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:04.883827 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:04.883832 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:04.883869 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:04.884799 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:04.884812 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:04.886396 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:04.886402 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:04.888504 (+ 2102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:04.888519 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:04.890431 (+ 1912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:04.890438 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:04.890599 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:04.890630 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 11:11:04.890703 (+ 73us) client_negotiation.cc:240] Negotiation successful
0812 11:11:04.890832 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"mutex_wait_us":1,"spinlock_wait_cycles":1280,"thread_start_us":337,"threads_started":1}
I20260812 11:11:04.891590 16770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.882282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52022 (local address 127.4.26.65:37083)
0812 11:11:04.883505 (+ 1223us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:04.883511 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:04.883526 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:11:04.883590 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:04.883594 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:04.883664 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:04.884965 (+ 1301us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:04.885185 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:04.886231 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:04.888739 (+ 2508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:04.890188 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:04.890983 (+ 795us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:04.891103 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:04.891175 (+ 72us) server_negotiation.cc:299] Negotiation successful
0812 11:11:04.891330 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1092,"thread_start_us":1000,"threads_started":1}
I20260812 11:11:04.892379 16764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.881239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33552 (local address 127.4.26.67:45777)
0812 11:11:04.883437 (+ 2198us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:04.883444 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:04.883465 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:11:04.883543 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:04.883547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:04.883675 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:04.883916 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:04.884411 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:04.885558 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:04.888320 (+ 2762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:04.889801 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:04.891743 (+ 1942us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:04.891886 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:04.891939 (+ 53us) server_negotiation.cc:299] Negotiation successful
0812 11:11:04.892065 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"spinlock_wait_cycles":3840,"thread_start_us":663,"threads_started":1}
I20260812 11:11:04.892527 15980 tablet_service.cc:1467] Processing CreateTablet for tablet c5423b3d08b64afb97c7c63df810ea7e (DEFAULT_TABLE table=test-table [id=3257b19f26044260889d29b84d36319b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:04.892982 15980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5423b3d08b64afb97c7c63df810ea7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:04.893942 16233 tablet_service.cc:1467] Processing CreateTablet for tablet c5423b3d08b64afb97c7c63df810ea7e (DEFAULT_TABLE table=test-table [id=3257b19f26044260889d29b84d36319b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:04.893942 16487 tablet_service.cc:1467] Processing CreateTablet for tablet c5423b3d08b64afb97c7c63df810ea7e (DEFAULT_TABLE table=test-table [id=3257b19f26044260889d29b84d36319b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:04.894454 16487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5423b3d08b64afb97c7c63df810ea7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:04.894454 16233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5423b3d08b64afb97c7c63df810ea7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:04.899075 16776 tablet_bootstrap.cc:492] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d: Bootstrap starting.
I20260812 11:11:04.901005 16776 tablet_bootstrap.cc:654] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:04.902524 16778 tablet_bootstrap.cc:492] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072: Bootstrap starting.
I20260812 11:11:04.904743 16778 tablet_bootstrap.cc:654] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:04.905553 16777 tablet_bootstrap.cc:492] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f: Bootstrap starting.
I20260812 11:11:04.907305 16777 tablet_bootstrap.cc:654] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:04.909832 16777 tablet_bootstrap.cc:492] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f: No bootstrap required, opened a new log
I20260812 11:11:04.909835 16776 tablet_bootstrap.cc:492] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d: No bootstrap required, opened a new log
I20260812 11:11:04.909899 16778 tablet_bootstrap.cc:492] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072: No bootstrap required, opened a new log
I20260812 11:11:04.910005 16776 ts_tablet_manager.cc:1397] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.007s
I20260812 11:11:04.910005 16777 ts_tablet_manager.cc:1397] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260812 11:11:04.910064 16778 ts_tablet_manager.cc:1397] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 11:11:04.910773 16778 raft_consensus.cc:348] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:04.910996 16778 raft_consensus.cc:374] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:04.910866 16777 raft_consensus.cc:348] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:04.911108 16778 raft_consensus.cc:729] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4167a41432a476688a1acac83242072, State: Initialized, Role: FOLLOWER
I20260812 11:11:04.911165 16777 raft_consensus.cc:374] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:04.911271 16777 raft_consensus.cc:729] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab1fd6437c64499fb788884c45137d6f, State: Initialized, Role: FOLLOWER
I20260812 11:11:04.910866 16776 raft_consensus.cc:348] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:04.911399 16778 consensus_queue.cc:260] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:04.911568 16776 raft_consensus.cc:374] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:04.911514 16777 consensus_queue.cc:260] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:04.911706 16776 raft_consensus.cc:729] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50c81efc0e36481abeda1faaad9fc87d, State: Initialized, Role: FOLLOWER
I20260812 11:11:04.912323 16778 ts_tablet_manager.cc:1428] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:11:04.912065 16776 consensus_queue.cc:260] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:04.916229 16788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.912652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.66:37261)
0812 11:11:04.915754 (+ 3102us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.915919 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2944,"threads_started":1}
I20260812 11:11:04.916766 16776 ts_tablet_manager.cc:1428] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d: Time spent starting tablet: real 0.007s user 0.003s sys 0.002s
I20260812 11:11:04.917395 16350 heartbeater.cc:503] Master 127.4.26.124:38157 was elected leader, sending a full tablet report...
I20260812 11:11:04.919354 16087 heartbeater.cc:503] Master 127.4.26.124:38157 was elected leader, sending a full tablet report...
I20260812 11:11:04.919812 16788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.918915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.66:34959)
0812 11:11:04.919458 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.919579 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422}
I20260812 11:11:04.923400 16792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.922188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.67:59891)
0812 11:11:04.922894 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.923087 (+ 193us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":441,"threads_started":1}
I20260812 11:11:04.929663 16777 ts_tablet_manager.cc:1428] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20260812 11:11:04.930030 16592 heartbeater.cc:503] Master 127.4.26.124:38157 was elected leader, sending a full tablet report...
I20260812 11:11:04.930965 16792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.930401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.67:47395)
0812 11:11:04.930694 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.930802 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160}
I20260812 11:11:04.932374 16791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.915889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.65:41309)
0812 11:11:04.931874 (+ 15985us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.932068 (+ 194us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15827,"thread_start_us":15664,"threads_started":1}
I20260812 11:11:04.933760 16791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:04.933334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.65:47645)
0812 11:11:04.933556 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:04.933650 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122}
I20260812 11:11:05.056182 16785 raft_consensus.cc:482] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:11:05.056418 16785 raft_consensus.cc:504] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:05.057426 16785 leader_election.cc:288] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4167a41432a476688a1acac83242072 (127.4.26.66:40653), 50c81efc0e36481abeda1faaad9fc87d (127.4.26.65:37083)
I20260812 11:11:05.058050 16268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5423b3d08b64afb97c7c63df810ea7e" candidate_uuid: "ab1fd6437c64499fb788884c45137d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4167a41432a476688a1acac83242072" is_pre_election: true
I20260812 11:11:05.058379 16268 raft_consensus.cc:2454] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab1fd6437c64499fb788884c45137d6f in term 0.
I20260812 11:11:05.058235 16010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5423b3d08b64afb97c7c63df810ea7e" candidate_uuid: "ab1fd6437c64499fb788884c45137d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50c81efc0e36481abeda1faaad9fc87d" is_pre_election: true
I20260812 11:11:05.058578 16010 raft_consensus.cc:2454] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab1fd6437c64499fb788884c45137d6f in term 0.
I20260812 11:11:05.059127 16402 leader_election.cc:302] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab1fd6437c64499fb788884c45137d6f, e4167a41432a476688a1acac83242072; no voters:
I20260812 11:11:05.059501 16785 raft_consensus.cc:2781] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:11:05.059645 16785 raft_consensus.cc:482] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:11:05.059751 16785 raft_consensus.cc:3037] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:05.062960 16785 raft_consensus.cc:504] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:05.063692 16785 leader_election.cc:288] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [CANDIDATE]: Term 1 election: Requested vote from peers e4167a41432a476688a1acac83242072 (127.4.26.66:40653), 50c81efc0e36481abeda1faaad9fc87d (127.4.26.65:37083)
I20260812 11:11:05.064342 16010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5423b3d08b64afb97c7c63df810ea7e" candidate_uuid: "ab1fd6437c64499fb788884c45137d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50c81efc0e36481abeda1faaad9fc87d"
I20260812 11:11:05.064422 16268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5423b3d08b64afb97c7c63df810ea7e" candidate_uuid: "ab1fd6437c64499fb788884c45137d6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4167a41432a476688a1acac83242072"
I20260812 11:11:05.064556 16010 raft_consensus.cc:3037] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:05.064690 16268 raft_consensus.cc:3037] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:05.067214 16010 raft_consensus.cc:2454] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab1fd6437c64499fb788884c45137d6f in term 1.
I20260812 11:11:05.068035 16404 leader_election.cc:302] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50c81efc0e36481abeda1faaad9fc87d, ab1fd6437c64499fb788884c45137d6f; no voters:
I20260812 11:11:05.068138 16268 raft_consensus.cc:2454] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab1fd6437c64499fb788884c45137d6f in term 1.
I20260812 11:11:05.068387 16785 raft_consensus.cc:2781] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:11:05.072597 16785 raft_consensus.cc:686] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [term 1 LEADER]: Becoming Leader. State: Replica: ab1fd6437c64499fb788884c45137d6f, State: Running, Role: LEADER
I20260812 11:11:05.073474 16785 consensus_queue.cc:237] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } } peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } }
I20260812 11:11:05.074061 16792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:05.073366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.67:53139)
0812 11:11:05.073664 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:05.073873 (+ 209us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165}
I20260812 11:11:05.077144 15796 catalog_manager.cc:5495] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f reported cstate change: term changed from 0 to 1, leader changed from <none> to ab1fd6437c64499fb788884c45137d6f (127.4.26.67). New cstate: current_term: 1 leader_uuid: "ab1fd6437c64499fb788884c45137d6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab1fd6437c64499fb788884c45137d6f" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 45777 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 } health_report { overall_health: UNKNOWN } } }
I20260812 11:11:05.138213 16764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:05.133359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33560 (local address 127.4.26.67:45777)
0812 11:11:05.133615 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:05.133626 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:05.133739 (+ 113us) server_negotiation.cc:407] Connection header received
0812 11:11:05.133984 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:05.133989 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:05.134069 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:05.134151 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:11:05.134466 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:05.135192 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:05.136482 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:05.136948 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:05.137046 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:05.137486 (+ 440us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:11:05.137635 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:11:05.137704 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:05.137869 (+ 165us) server_negotiation.cc:299] Negotiation successful
0812 11:11:05.137939 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:11:05.141425 16010 raft_consensus.cc:1261] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d [term 1 FOLLOWER]: Refusing update from remote peer ab1fd6437c64499fb788884c45137d6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:11:05.141481 16268 raft_consensus.cc:1261] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072 [term 1 FOLLOWER]: Refusing update from remote peer ab1fd6437c64499fb788884c45137d6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:11:05.142108 16793 consensus_queue.cc:1035] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4167a41432a476688a1acac83242072" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:11:05.142529 16785 consensus_queue.cc:1035] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "50c81efc0e36481abeda1faaad9fc87d" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 37083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:11:05.145046 16791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:05.144373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.65:45427)
0812 11:11:05.144665 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:05.144815 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
I20260812 11:11:05.156208 16799 mvcc.cc:205] Tried to move back new op lower bound from 7317639434812923904 to 7317639434543964160. Current Snapshot: MvccSnapshot[applied={T|T < 7317639434812923904}]
I20260812 11:11:05.157923 16791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:05.155539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.65:49403)
0812 11:11:05.157634 (+ 2095us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:05.157741 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1970}
I20260812 11:11:05.158718 16792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:05.157706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.67:44201)
0812 11:11:05.158439 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:05.158541 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":626}
I20260812 11:11:05.159785 16788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:05.159094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.66:58885)
0812 11:11:05.159508 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:05.159597 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":299}
I20260812 11:11:05.160808 16792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:05.160349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.67:37683)
0812 11:11:05.160549 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:05.160653 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260812 11:11:05.162314 16788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:05.161705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.4.26.66:60725)
0812 11:11:05.162016 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:05.162127 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180}
I20260812 11:11:05.169167 15797 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39638:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:11:05.169550 15797 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39638:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:11:05.178910 15797 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 034e13bde73543c6871b5ecf9b75c914: Sending DeleteTablet for 3 replicas of tablet c5423b3d08b64afb97c7c63df810ea7e
I20260812 11:11:05.180909 15980 tablet_service.cc:1514] Processing DeleteTablet for tablet c5423b3d08b64afb97c7c63df810ea7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:05 UTC) from {username='oryx', principal='oryx/127.4.26.124@KRBTEST.COM'} at 127.0.0.1:52022
I20260812 11:11:05.181243 16487 tablet_service.cc:1514] Processing DeleteTablet for tablet c5423b3d08b64afb97c7c63df810ea7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:05 UTC) from {username='oryx', principal='oryx/127.4.26.124@KRBTEST.COM'} at 127.0.0.1:33552
I20260812 11:11:05.181679 16812 tablet_replica.cc:330] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d: stopping tablet replica
I20260812 11:11:05.181902 16812 raft_consensus.cc:2229] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:11:05.182361 16812 raft_consensus.cc:2258] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:05.183802 16233 tablet_service.cc:1514] Processing DeleteTablet for tablet c5423b3d08b64afb97c7c63df810ea7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:05 UTC) from {username='oryx', principal='oryx/127.4.26.124@KRBTEST.COM'} at 127.0.0.1:56244
I20260812 11:11:05.184080 16812 ts_tablet_manager.cc:1905] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:05.185312 16816 tablet_replica.cc:330] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072: stopping tablet replica
I20260812 11:11:05.185564 16816 raft_consensus.cc:2229] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:11:05.185962 16816 raft_consensus.cc:2258] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:05.186012 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 15767
I20260812 11:11:05.187318 16816 ts_tablet_manager.cc:1905] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:05.189610 16813 tablet_replica.cc:330] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f: stopping tablet replica
I20260812 11:11:05.189960 16813 raft_consensus.cc:2229] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:11:05.190502 16813 raft_consensus.cc:2258] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:05.191728 16813 ts_tablet_manager.cc:1905] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:05.192476 16812 ts_tablet_manager.cc:1918] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:11:05.193336 16812 log.cc:1196] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/c5423b3d08b64afb97c7c63df810ea7e
I20260812 11:11:05.193881 16812 ts_tablet_manager.cc:1939] T c5423b3d08b64afb97c7c63df810ea7e P 50c81efc0e36481abeda1faaad9fc87d: Deleting consensus metadata
I20260812 11:11:05.194290 16816 ts_tablet_manager.cc:1918] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:11:05.194483 16816 log.cc:1196] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/c5423b3d08b64afb97c7c63df810ea7e
I20260812 11:11:05.194963 16816 ts_tablet_manager.cc:1939] T c5423b3d08b64afb97c7c63df810ea7e P e4167a41432a476688a1acac83242072: Deleting consensus metadata
I20260812 11:11:05.195221 15774 catalog_manager.cc:4841] TS 50c81efc0e36481abeda1faaad9fc87d (127.4.26.65:37083): tablet c5423b3d08b64afb97c7c63df810ea7e (table test-table [id=3257b19f26044260889d29b84d36319b]) successfully deleted
I20260812 11:11:05.196216 15770 catalog_manager.cc:4841] TS e4167a41432a476688a1acac83242072 (127.4.26.66:40653): tablet c5423b3d08b64afb97c7c63df810ea7e (table test-table [id=3257b19f26044260889d29b84d36319b]) successfully deleted
I20260812 11:11:05.198738 16813 ts_tablet_manager.cc:1918] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:11:05.198894 16813 log.cc:1196] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/c5423b3d08b64afb97c7c63df810ea7e
I20260812 11:11:05.199359 16813 ts_tablet_manager.cc:1939] T c5423b3d08b64afb97c7c63df810ea7e P ab1fd6437c64499fb788884c45137d6f: Deleting consensus metadata
I20260812 11:11:05.200349 15774 catalog_manager.cc:4841] TS ab1fd6437c64499fb788884c45137d6f (127.4.26.67:45777): tablet c5423b3d08b64afb97c7c63df810ea7e (table test-table [id=3257b19f26044260889d29b84d36319b]) successfully deleted
I20260812 11:11:05.207223 16770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:05.187710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52032 (local address 127.4.26.65:37083)
0812 11:11:05.187895 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:05.187902 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:05.193177 (+ 5275us) server_negotiation.cc:407] Connection header received
0812 11:11:05.193414 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:05.193420 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:05.193517 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:05.193602 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:05.196020 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:05.197197 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:05.198678 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:05.199292 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:05.199444 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:05.202077 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:05.202095 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:05.202114 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:05.202148 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:05.204754 (+ 2606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:05.205457 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:05.205465 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:05.205500 (+ 35us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:05.205632 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:05.205929 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:05.205932 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:05.205934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:05.206305 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:05.206576 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:05.206744 (+ 168us) server_negotiation.cc:299] Negotiation successful
0812 11:11:05.206917 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:11:05.207883 16078 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:05.247117 16768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:05.246678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59946)
0812 11:11:05.246855 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:05.246955 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260812 11:11:05.248214 16768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:05.247831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59956)
0812 11:11:05.247993 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:05.248079 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260812 11:11:05.302134 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 15767
I20260812 11:11:05.321848 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 16111
I20260812 11:11:05.336755 16766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:05.322651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56256 (local address 127.4.26.66:40653)
0812 11:11:05.322885 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:05.322892 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:05.322981 (+ 89us) server_negotiation.cc:407] Connection header received
0812 11:11:05.323181 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:05.323185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:05.323252 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:05.323355 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:05.324804 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:05.325577 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:05.326888 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:05.327473 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:05.327623 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:05.330563 (+ 2940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:05.330582 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:05.330601 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:05.330650 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:05.333814 (+ 3164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:05.334557 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:05.334566 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:05.334568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:05.334721 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:05.335138 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:05.335144 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:05.335146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:05.335549 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:05.335870 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:05.336180 (+ 310us) server_negotiation.cc:299] Negotiation successful
0812 11:11:05.336413 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 11:11:05.337613 16342 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:05.431993 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 16111
I20260812 11:11:05.463765 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 16370
I20260812 11:11:05.478257 16764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:05.464608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33576 (local address 127.4.26.67:45777)
0812 11:11:05.464796 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:05.464801 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:05.464820 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:11:05.464988 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:05.464993 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:05.465077 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:05.465226 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:05.466733 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:05.467480 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:05.468790 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:05.469243 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:05.469340 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:05.471886 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:05.471905 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:05.471925 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:05.471968 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:05.474994 (+ 3026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:05.475905 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:05.475914 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:05.475917 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:05.476093 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:05.476587 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:05.476593 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:05.476595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:05.477027 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:05.477343 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:05.477725 (+ 382us) server_negotiation.cc:299] Negotiation successful
0812 11:11:05.477933 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 11:11:05.479028 16583 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:05.599833 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 16370
I20260812 11:11:05.626256 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 15267
I20260812 11:11:05.627509 15539 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:05.700114 16768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:05.699577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59962)
0812 11:11:05.699780 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:05.699913 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260812 11:11:05.701243 16768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:05.700810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:38963 (local address 127.0.0.1:59970)
0812 11:11:05.700975 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:05.701063 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:38963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 11:11:05.746771 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 15267
I20260812 11:11:05.774709 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 15435
I20260812 11:11:05.776014 15839 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:05.900755 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 15435
2026-08-12T11:11:05Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (12391 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:11:06 dist-test-slave-rmhg krb5kdc[16833](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:11:06 dist-test-slave-rmhg krb5kdc[16833](info): set up 2 sockets
Aug 12 11:11:06 dist-test-slave-rmhg krb5kdc[16833](info): commencing operation
krb5kdc: starting...
W20260812 11:11:07.180007 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.227s user 0.003s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:11:07 dist-test-slave-rmhg krb5kdc[16833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533067, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:11:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:11:07Z Disabled control of system clock
WARNING: no policy specified for oryx/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.126.keytab.
Entry for principal oryx/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.126.keytab.
I20260812 11:11:07.442740 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:41881
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.126.keytab
--principal=oryx/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:41881
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:11:07.791934 16850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:07.792292 16850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:07.792416 16850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:07.800177 16850 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:11:07.800323 16850 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260812 11:11:07.800369 16850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:07.800458 16850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:07.800522 16850 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:11:07.800618 16850 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:11:07.811715 16850 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:41881
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.126.keytab
--principal=oryx/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:41881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:07.813117 16850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:07.814663 16850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:07.827409 16855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:07.827459 16861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:07.827662 16864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:07.827948 16850 server_base.cc:1034] running on GCE node
I20260812 11:11:07.828935 16850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:07.830577 16850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:07.831856 16850 hybrid_clock.cc:648] HybridClock initialized: now 1786533067831766 us; error 58 us; skew 500 ppm
I20260812 11:11:07.832285 16850 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:07 dist-test-slave-rmhg krb5kdc[16833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533067, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:07.835619 16850 init.cc:377] Logged in from keytab as oryx/127.4.26.126@KRBTEST.COM (short username oryx)
I20260812 11:11:07.837338 16850 webserver.cc:460] Webserver started at http://127.4.26.126:44281/ using document root <none> and password file <none>
I20260812 11:11:07.838080 16850 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:07.838193 16850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:07.838522 16850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:07.841878 16850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "f99d7399c6e64771bcac7781edc63d9c"
format_stamp: "Formatted at 2026-08-12 11:11:07 on dist-test-slave-rmhg"
server_key: "81517d2249604d2a6e871d203d1b418a"
server_key_iv: "d50284b6e298889f86cca80c748c1c08"
server_key_version: "encryptionkey@0"
I20260812 11:11:07.843041 16850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "f99d7399c6e64771bcac7781edc63d9c"
format_stamp: "Formatted at 2026-08-12 11:11:07 on dist-test-slave-rmhg"
server_key: "81517d2249604d2a6e871d203d1b418a"
server_key_iv: "d50284b6e298889f86cca80c748c1c08"
server_key_version: "encryptionkey@0"
I20260812 11:11:07.852797 16850 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.004s sys 0.004s
I20260812 11:11:07.856724 16878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:07.858345 16850 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:11:07.858536 16850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "f99d7399c6e64771bcac7781edc63d9c"
format_stamp: "Formatted at 2026-08-12 11:11:07 on dist-test-slave-rmhg"
server_key: "81517d2249604d2a6e871d203d1b418a"
server_key_iv: "d50284b6e298889f86cca80c748c1c08"
server_key_version: "encryptionkey@0"
I20260812 11:11:07.858791 16850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:07.875138 16850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:07.879948 16850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:07.880255 16850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:07.902074 16850 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:41881
I20260812 11:11:07.902094 16977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:41881 every 8 connection(s)
I20260812 11:11:07.903573 16850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:11:07.907565 16978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:07.909401 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 16850
I20260812 11:11:07.909612 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:11:07.910451 4201 external_mini_cluster.cc:1428] Setting key ab7b5708634a670044ad370a17316ba0
I20260812 11:11:07.920501 16978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c: Bootstrap starting.
I20260812 11:11:07.924599 16978 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c: Neither blocks nor log segments found. Creating new log.
Aug 12 11:11:07 dist-test-slave-rmhg krb5kdc[16833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533067, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM
I20260812 11:11:07.925908 16978 log.cc:824] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:11:07.929597 16978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c: No bootstrap required, opened a new log
I20260812 11:11:07.934883 16982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:07.912690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35544 (local address 127.4.26.126:41881)
0812 11:11:07.913570 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:07.913583 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:07.913626 (+ 43us) server_negotiation.cc:407] Connection header received
0812 11:11:07.915348 (+ 1722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:07.915372 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:07.915767 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:07.916094 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:07.917862 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:07.919210 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:07.920916 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:07.921668 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:07.921799 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:07.926862 (+ 5063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:07.926875 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:07.926898 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:07.926951 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:07.930313 (+ 3362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:07.931266 (+ 953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:07.931273 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:07.931280 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:07.931459 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:07.931913 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:07.931917 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:07.931919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:07.932539 (+ 620us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:07.932781 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:07.933324 (+ 543us) server_negotiation.cc:299] Negotiation successful
0812 11:11:07.933781 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":443,"threads_started":1}
I20260812 11:11:07.938969 16978 raft_consensus.cc:348] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f99d7399c6e64771bcac7781edc63d9c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41881 } }
I20260812 11:11:07.939384 16978 raft_consensus.cc:374] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:07.939496 16978 raft_consensus.cc:729] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f99d7399c6e64771bcac7781edc63d9c, State: Initialized, Role: FOLLOWER
I20260812 11:11:07.940106 16978 consensus_queue.cc:260] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f99d7399c6e64771bcac7781edc63d9c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41881 } }
I20260812 11:11:07.940344 16978 raft_consensus.cc:388] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:11:07.940495 16978 raft_consensus.cc:482] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:11:07.940680 16978 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:07.943291 16978 raft_consensus.cc:504] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f99d7399c6e64771bcac7781edc63d9c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41881 } }
I20260812 11:11:07.943884 16978 leader_election.cc:302] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f99d7399c6e64771bcac7781edc63d9c; no voters:
I20260812 11:11:07.944519 16978 leader_election.cc:288] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:11:07.944645 16985 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:11:07.946029 16985 raft_consensus.cc:686] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [term 1 LEADER]: Becoming Leader. State: Replica: f99d7399c6e64771bcac7781edc63d9c, State: Running, Role: LEADER
I20260812 11:11:07.946844 16978 sys_catalog.cc:564] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:11:07.946770 16985 consensus_queue.cc:237] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f99d7399c6e64771bcac7781edc63d9c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41881 } }
I20260812 11:11:07.949532 16990 sys_catalog.cc:455] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f99d7399c6e64771bcac7781edc63d9c. Latest consensus state: current_term: 1 leader_uuid: "f99d7399c6e64771bcac7781edc63d9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f99d7399c6e64771bcac7781edc63d9c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41881 } } }
I20260812 11:11:07.949575 16986 sys_catalog.cc:455] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f99d7399c6e64771bcac7781edc63d9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f99d7399c6e64771bcac7781edc63d9c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41881 } } }
I20260812 11:11:07.950062 16990 sys_catalog.cc:458] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [sys.catalog]: This master's current role is: LEADER
I20260812 11:11:07.950135 16986 sys_catalog.cc:458] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c [sys.catalog]: This master's current role is: LEADER
I20260812 11:11:07.951396 17000 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:11:07.957284 17000 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:11:07.967657 17000 catalog_manager.cc:1347] Generated new cluster ID: e6a54d776e44493d85e0651b92568274
I20260812 11:11:07.967795 17000 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:11:07.989611 17000 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:11:07.991695 17000 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:11:07.999706 17000 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c: Generated new TSK 0
I20260812 11:11:08.000897 17000 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.65.keytab.
Entry for principal oryx/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.65.keytab.
I20260812 11:11:08.076807 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:41881
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.65.keytab
--principal=oryx/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:11:08.439465 17024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:08.439801 17024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:08.439931 17024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:08.447523 17024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:08.447655 17024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:08.447772 17024 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:11:08.447883 17024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:11:08.458379 17024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.65.keytab
--principal=oryx/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.26.126:41881
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:08.459787 17024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:08.461256 17024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:08.476131 17031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:08.476091 17036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:08.476015 17034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:08.477105 17024 server_base.cc:1034] running on GCE node
I20260812 11:11:08.477846 17024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:08.478874 17024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:08.480132 17024 hybrid_clock.cc:648] HybridClock initialized: now 1786533068480053 us; error 54 us; skew 500 ppm
I20260812 11:11:08.480471 17024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:08 dist-test-slave-rmhg krb5kdc[16833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533068, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:08.483934 17024 init.cc:377] Logged in from keytab as oryx/127.4.26.65@KRBTEST.COM (short username oryx)
I20260812 11:11:08.485705 17024 webserver.cc:460] Webserver started at http://127.4.26.65:39895/ using document root <none> and password file <none>
I20260812 11:11:08.486488 17024 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:08.486604 17024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:08.486955 17024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:08.490237 17024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "c0affbbc08c5422e8aba5300ecd6fea9"
format_stamp: "Formatted at 2026-08-12 11:11:08 on dist-test-slave-rmhg"
server_key: "4c2e0e97fe73360579037181780ccd4c"
server_key_iv: "366dbe0715b090ccb94776d39fe90397"
server_key_version: "encryptionkey@0"
I20260812 11:11:08.491111 17024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "c0affbbc08c5422e8aba5300ecd6fea9"
format_stamp: "Formatted at 2026-08-12 11:11:08 on dist-test-slave-rmhg"
server_key: "4c2e0e97fe73360579037181780ccd4c"
server_key_iv: "366dbe0715b090ccb94776d39fe90397"
server_key_version: "encryptionkey@0"
I20260812 11:11:08.496812 17024 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:11:08.500823 17050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:08.502378 17024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:11:08.502566 17024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "c0affbbc08c5422e8aba5300ecd6fea9"
format_stamp: "Formatted at 2026-08-12 11:11:08 on dist-test-slave-rmhg"
server_key: "4c2e0e97fe73360579037181780ccd4c"
server_key_iv: "366dbe0715b090ccb94776d39fe90397"
server_key_version: "encryptionkey@0"
I20260812 11:11:08.502806 17024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:08.529855 17024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:08.534682 17024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:08.534968 17024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:08.538009 17024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:08.538117 17024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:08.538255 17024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:08.538314 17024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:11:08 dist-test-slave-rmhg krb5kdc[16833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533068, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM
I20260812 11:11:08.565106 17071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:08.538930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:36601 (local address 127.4.26.126:41881)
0812 11:11:08.539435 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:08.539443 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:08.540918 (+ 1475us) server_negotiation.cc:407] Connection header received
0812 11:11:08.544109 (+ 3191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:08.544116 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:08.544228 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:08.544361 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:08.547068 (+ 2707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:08.548337 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:08.551093 (+ 2756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:08.551632 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:08.551753 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:08.557332 (+ 5579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:08.557338 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:08.557342 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:08.557383 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:08.560461 (+ 3078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:08.561706 (+ 1245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:08.561713 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:08.561716 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:08.561904 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:08.562542 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:08.562548 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:08.562552 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:08.562930 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:08.563090 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:08.564313 (+ 1223us) server_negotiation.cc:299] Negotiation successful
0812 11:11:08.564663 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":252,"threads_started":1}
I20260812 11:11:08.565933 17072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:08.539638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41881 (local address 127.4.26.65:36601)
0812 11:11:08.540663 (+ 1025us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:08.540744 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:08.543650 (+ 2906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:08.544738 (+ 1088us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:08.544752 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:08.545662 (+ 910us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:08.546768 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:08.546800 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:08.548610 (+ 1810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:08.548617 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:08.550804 (+ 2187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:08.550825 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:08.551931 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:08.551940 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:08.552296 (+ 356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:08.553302 (+ 1006us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:08.553343 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:08.556940 (+ 3597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:08.560659 (+ 3719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:08.560674 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:08.560700 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:08.561515 (+ 815us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:08.562044 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:08.562048 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:08.562051 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:08.562393 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:08.563175 (+ 782us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:08.563184 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:08.563763 (+ 579us) client_negotiation.cc:769] Sending connection context
0812 11:11:08.564145 (+ 382us) client_negotiation.cc:240] Negotiation successful
0812 11:11:08.564670 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"thread_start_us":405,"threads_started":1}
I20260812 11:11:08.591615 17024 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:45829
I20260812 11:11:08.591636 17273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:45829 every 8 connection(s)
I20260812 11:11:08.592272 17071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:08.573824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:40351 (local address 127.4.26.126:41881)
0812 11:11:08.574049 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:08.574055 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:08.575007 (+ 952us) server_negotiation.cc:407] Connection header received
0812 11:11:08.575319 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:08.575327 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:08.575427 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:08.575516 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:08.577422 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:08.578344 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:08.580726 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:08.581400 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:08.581640 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:08.584594 (+ 2954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:08.584601 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:08.584605 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:08.584649 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:08.588584 (+ 3935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:08.589815 (+ 1231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:08.589821 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:08.589823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:08.590005 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:08.590588 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:08.590595 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:08.590599 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:08.590984 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:08.591154 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:08.591655 (+ 501us) server_negotiation.cc:299] Negotiation successful
0812 11:11:08.591905 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 11:11:08.592397 17203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:08.573823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41881 (local address 127.4.26.65:40351)
0812 11:11:08.574820 (+ 997us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:08.574851 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:08.575083 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:08.575782 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:08.575788 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:08.576644 (+ 856us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:08.577111 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:08.577130 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:08.578582 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:08.578587 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:08.580372 (+ 1785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:08.580400 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:08.581731 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:08.581741 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:08.581964 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:08.582868 (+ 904us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:08.582896 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:08.584191 (+ 1295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:08.588841 (+ 4650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:08.588849 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:08.588853 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:08.589626 (+ 773us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:08.590175 (+ 549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:08.590181 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:08.590185 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:08.590380 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:08.591161 (+ 781us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:08.591167 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:08.591365 (+ 198us) client_negotiation.cc:769] Sending connection context
0812 11:11:08.591513 (+ 148us) client_negotiation.cc:240] Negotiation successful
0812 11:11:08.591941 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":782,"thread_start_us":486,"threads_started":1}
I20260812 11:11:08.593291 17024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:11:08.595669 17276 heartbeater.cc:347] Connected to a master server at 127.4.26.126:41881
I20260812 11:11:08.595939 17276 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:08.596803 17276 heartbeater.cc:511] Master 127.4.26.126:41881 requested a full tablet report, sending...
I20260812 11:11:08.599119 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 17024
I20260812 11:11:08.599094 16909 ts_manager.cc:194] Registered new tserver with Master: c0affbbc08c5422e8aba5300ecd6fea9 (127.4.26.65:45829)
I20260812 11:11:08.599323 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:11:08.599964 4201 external_mini_cluster.cc:1428] Setting key 660424bdd4591c2f53295bab5226e766
I20260812 11:11:08.600741 16909 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:36601
WARNING: no policy specified for oryx/127.4.26.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.26.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.66.keytab.
Entry for principal oryx/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.66.keytab.
I20260812 11:11:08.657270 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:41881
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.66.keytab
--principal=oryx/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:11:09.018662 17282 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:09.019003 17282 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:09.019135 17282 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:09.026968 17282 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:09.027115 17282 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:09.027241 17282 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:11:09.027349 17282 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:11:09.037784 17282 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.66.keytab
--principal=oryx/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.26.126:41881
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:09.039234 17282 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:09.040686 17282 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:09.055508 17287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:09.055562 17295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:09.055591 17291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:09.056581 17282 server_base.cc:1034] running on GCE node
I20260812 11:11:09.057343 17282 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:09.058377 17282 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:09.059623 17282 hybrid_clock.cc:648] HybridClock initialized: now 1786533069059539 us; error 51 us; skew 500 ppm
I20260812 11:11:09.060007 17282 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:09 dist-test-slave-rmhg krb5kdc[16833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533069, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:09.063532 17282 init.cc:377] Logged in from keytab as oryx/127.4.26.66@KRBTEST.COM (short username oryx)
I20260812 11:11:09.065340 17282 webserver.cc:460] Webserver started at http://127.4.26.66:44995/ using document root <none> and password file <none>
I20260812 11:11:09.066145 17282 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:09.066269 17282 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:09.066741 17282 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:09.070268 17282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "3162c6992e8d4637afd98a19c33fc903"
format_stamp: "Formatted at 2026-08-12 11:11:09 on dist-test-slave-rmhg"
server_key: "a4685d13b03423c70cc233958a27a338"
server_key_iv: "136a4a5d8ab6aee51fdf2419d1252730"
server_key_version: "encryptionkey@0"
I20260812 11:11:09.071131 17282 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "3162c6992e8d4637afd98a19c33fc903"
format_stamp: "Formatted at 2026-08-12 11:11:09 on dist-test-slave-rmhg"
server_key: "a4685d13b03423c70cc233958a27a338"
server_key_iv: "136a4a5d8ab6aee51fdf2419d1252730"
server_key_version: "encryptionkey@0"
I20260812 11:11:09.076938 17282 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260812 11:11:09.081342 17310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:09.083056 17282 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:11:09.083271 17282 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "3162c6992e8d4637afd98a19c33fc903"
format_stamp: "Formatted at 2026-08-12 11:11:09 on dist-test-slave-rmhg"
server_key: "a4685d13b03423c70cc233958a27a338"
server_key_iv: "136a4a5d8ab6aee51fdf2419d1252730"
server_key_version: "encryptionkey@0"
I20260812 11:11:09.083518 17282 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:09.112326 17282 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:09.117244 17282 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:09.117513 17282 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:09.120499 17282 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:09.120600 17282 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:09.120736 17282 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:09.120803 17282 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:11:09 dist-test-slave-rmhg krb5kdc[16833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533069, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM
I20260812 11:11:09.146232 17326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:09.121286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:35387 (local address 127.4.26.126:41881)
0812 11:11:09.121892 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:09.121899 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:09.123215 (+ 1316us) server_negotiation.cc:407] Connection header received
0812 11:11:09.125955 (+ 2740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:09.125962 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:09.126067 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:09.126171 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:09.128673 (+ 2502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.129820 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.133203 (+ 3383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.133833 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.133991 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:09.138749 (+ 4758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:09.138756 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:09.138761 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:09.138812 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:09.142356 (+ 3544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:09.143516 (+ 1160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:09.143521 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:09.143523 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:09.143671 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:09.144152 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:09.144156 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:09.144159 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:09.144462 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:09.144619 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:09.145569 (+ 950us) server_negotiation.cc:299] Negotiation successful
0812 11:11:09.145819 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":326,"threads_started":1}
I20260812 11:11:09.147469 17329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:09.122025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41881 (local address 127.4.26.66:35387)
0812 11:11:09.122984 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:09.123038 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:09.125499 (+ 2461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:09.126481 (+ 982us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:09.126492 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:09.127406 (+ 914us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:09.128410 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:09.128448 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.130101 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.130114 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:09.132911 (+ 2797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:09.132940 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.134162 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.134172 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:09.134425 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:09.135348 (+ 923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:09.135388 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:09.138396 (+ 3008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:09.142527 (+ 4131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:09.142548 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:09.142575 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:09.143326 (+ 751us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:09.143799 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:09.143804 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:09.143808 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:09.144022 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:09.144618 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:09.144628 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:09.145066 (+ 438us) client_negotiation.cc:769] Sending connection context
0812 11:11:09.145464 (+ 398us) client_negotiation.cc:240] Negotiation successful
0812 11:11:09.146106 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":396,"threads_started":1}
I20260812 11:11:09.169822 17326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:09.153622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:48623 (local address 127.4.26.126:41881)
0812 11:11:09.153839 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:09.153847 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:09.154397 (+ 550us) server_negotiation.cc:407] Connection header received
0812 11:11:09.154673 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:09.154677 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:09.154748 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:09.154831 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:09.156568 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.157748 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.159752 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.160180 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.160298 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:09.163001 (+ 2703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:09.163008 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:09.163011 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:09.163112 (+ 101us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:09.166354 (+ 3242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:09.167340 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:09.167348 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:09.167351 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:09.167549 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:09.167975 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:09.167981 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:09.167985 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:09.168560 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:09.168733 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:09.169182 (+ 449us) server_negotiation.cc:299] Negotiation successful
0812 11:11:09.169463 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:11:09.169951 17450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:09.153578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41881 (local address 127.4.26.66:48623)
0812 11:11:09.154278 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:09.154300 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:09.154506 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:09.155028 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:09.155033 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:09.155883 (+ 850us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:09.156336 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:09.156356 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.157950 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.157957 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:09.159575 (+ 1618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:09.159597 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.160382 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.160390 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:09.160552 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:09.161385 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:09.161414 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:09.162714 (+ 1300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:09.166527 (+ 3813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:09.166543 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:09.166548 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:09.167177 (+ 629us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:09.167706 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:09.167711 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:09.167715 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:09.167856 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:09.168685 (+ 829us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:09.168689 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:09.168867 (+ 178us) client_negotiation.cc:769] Sending connection context
0812 11:11:09.168985 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 11:11:09.169403 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":352,"threads_started":1}
I20260812 11:11:09.172016 17282 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:37975
I20260812 11:11:09.172089 17529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:37975 every 8 connection(s)
I20260812 11:11:09.173422 17282 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:11:09.175625 17532 heartbeater.cc:347] Connected to a master server at 127.4.26.126:41881
I20260812 11:11:09.175868 17532 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:09.176169 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 17282
I20260812 11:11:09.176334 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:11:09.176617 17532 heartbeater.cc:511] Master 127.4.26.126:41881 requested a full tablet report, sending...
I20260812 11:11:09.176857 4201 external_mini_cluster.cc:1428] Setting key 8e4277399a1e09ed26e819bfa00d8912
I20260812 11:11:09.178218 16908 ts_manager.cc:194] Registered new tserver with Master: 3162c6992e8d4637afd98a19c33fc903 (127.4.26.66:37975)
I20260812 11:11:09.179391 16908 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:35387
WARNING: no policy specified for oryx/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.67.keytab.
Entry for principal oryx/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.67.keytab.
I20260812 11:11:09.236060 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:41881
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.67.keytab
--principal=oryx/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:11:09.583006 17536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:09.583333 17536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:09.583467 17536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:09.591452 17536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:09.591616 17536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:09.591758 17536 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 11:11:09.591887 17536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:11:09.603902 17276 heartbeater.cc:503] Master 127.4.26.126:41881 was elected leader, sending a full tablet report...
I20260812 11:11:09.603900 17536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.67.keytab
--principal=oryx/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.26.126:41881
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:09.605453 17536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:09.606948 17536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:09.620204 17544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:09.620261 17545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:09.620265 17548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:09.620932 17536 server_base.cc:1034] running on GCE node
I20260812 11:11:09.621634 17536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:09.622576 17536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:09.623792 17536 hybrid_clock.cc:648] HybridClock initialized: now 1786533069623728 us; error 38 us; skew 500 ppm
I20260812 11:11:09.624099 17536 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:09 dist-test-slave-rmhg krb5kdc[16833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533069, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:09.627477 17536 init.cc:377] Logged in from keytab as oryx/127.4.26.67@KRBTEST.COM (short username oryx)
I20260812 11:11:09.628908 17536 webserver.cc:460] Webserver started at http://127.4.26.67:37429/ using document root <none> and password file <none>
I20260812 11:11:09.629674 17536 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:09.629770 17536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:09.630149 17536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:09.633138 17536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00"
format_stamp: "Formatted at 2026-08-12 11:11:09 on dist-test-slave-rmhg"
server_key: "be46ba4d4352a134c3ad9f1c2a532db4"
server_key_iv: "61c16d042b55985d44f7eb13fbcb5a03"
server_key_version: "encryptionkey@0"
I20260812 11:11:09.634019 17536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00"
format_stamp: "Formatted at 2026-08-12 11:11:09 on dist-test-slave-rmhg"
server_key: "be46ba4d4352a134c3ad9f1c2a532db4"
server_key_iv: "61c16d042b55985d44f7eb13fbcb5a03"
server_key_version: "encryptionkey@0"
I20260812 11:11:09.639590 17536 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:11:09.643522 17559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:09.645012 17536 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:11:09.645226 17536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00"
format_stamp: "Formatted at 2026-08-12 11:11:09 on dist-test-slave-rmhg"
server_key: "be46ba4d4352a134c3ad9f1c2a532db4"
server_key_iv: "61c16d042b55985d44f7eb13fbcb5a03"
server_key_version: "encryptionkey@0"
I20260812 11:11:09.645462 17536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:09.670264 17536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:09.675011 17536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:09.675300 17536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:09.678197 17536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:09.678292 17536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:09.678411 17536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:09.678479 17536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:11:09 dist-test-slave-rmhg krb5kdc[16833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533069, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM
I20260812 11:11:09.704064 17575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:09.678699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:49725 (local address 127.4.26.126:41881)
0812 11:11:09.679408 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:09.679415 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:09.680576 (+ 1161us) server_negotiation.cc:407] Connection header received
0812 11:11:09.682790 (+ 2214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:09.682797 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:09.682900 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:09.683022 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:09.685950 (+ 2928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.686933 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.689212 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.689772 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.689909 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:09.695358 (+ 5449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:09.695367 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:09.695372 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:09.695422 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:09.699305 (+ 3883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:09.700597 (+ 1292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:09.700605 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:09.700608 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:09.700814 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:09.701522 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:09.701528 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:09.701532 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:09.701968 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:09.702140 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:09.703354 (+ 1214us) server_negotiation.cc:299] Negotiation successful
0812 11:11:09.703632 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":421,"threads_started":1}
I20260812 11:11:09.706110 17576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:09.679400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41881 (local address 127.4.26.67:49725)
0812 11:11:09.680360 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:09.680424 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:09.682439 (+ 2015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:09.683382 (+ 943us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:09.683396 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:09.684416 (+ 1020us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:09.685649 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:09.685687 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.687177 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.687184 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:09.688965 (+ 1781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:09.688982 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.690047 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.690056 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:09.690403 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:09.691311 (+ 908us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:09.691355 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:09.694970 (+ 3615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:09.699518 (+ 4548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:09.699533 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:09.699559 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:09.700410 (+ 851us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:09.700958 (+ 548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:09.700964 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:09.700968 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:09.701366 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:09.702185 (+ 819us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:09.702196 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:09.702805 (+ 609us) client_negotiation.cc:769] Sending connection context
0812 11:11:09.703218 (+ 413us) client_negotiation.cc:240] Negotiation successful
0812 11:11:09.703936 (+ 718us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"thread_start_us":388,"threads_started":1}
I20260812 11:11:09.722458 17536 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:40457
I20260812 11:11:09.722543 17759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:40457 every 8 connection(s)
I20260812 11:11:09.724021 17536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:11:09.726524 17760 heartbeater.cc:347] Connected to a master server at 127.4.26.126:41881
I20260812 11:11:09.726882 17760 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:09.727566 17760 heartbeater.cc:511] Master 127.4.26.126:41881 requested a full tablet report, sending...
I20260812 11:11:09.728986 16908 ts_manager.cc:194] Registered new tserver with Master: 0a8dcad2bfd4426ebdb7ab5ed7402e00 (127.4.26.67:40457)
I20260812 11:11:09.730085 16908 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:49725
I20260812 11:11:09.731567 17575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:09.713491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:33641 (local address 127.4.26.126:41881)
0812 11:11:09.713696 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:09.713703 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:09.717916 (+ 4213us) server_negotiation.cc:407] Connection header received
0812 11:11:09.718159 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:09.718165 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:09.718271 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:09.718390 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:09.720060 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.721206 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.723105 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.723679 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.723800 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:09.726002 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:09.726009 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:09.726014 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:09.726067 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:09.728905 (+ 2838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:09.729706 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:09.729711 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:09.729713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:09.729853 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:09.730238 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:09.730243 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:09.730247 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:09.730584 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:09.730729 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:09.731132 (+ 403us) server_negotiation.cc:299] Negotiation successful
0812 11:11:09.731323 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:11:09.731878 17736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:09.713458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41881 (local address 127.4.26.67:33641)
0812 11:11:09.717768 (+ 4310us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:09.717799 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:09.717992 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:09.718444 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:09.718449 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:09.719221 (+ 772us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:09.719829 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:09.719846 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.721348 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.721353 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:09.722974 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:09.722988 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.723872 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.723877 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:09.724002 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:09.724710 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:09.724739 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:09.725750 (+ 1011us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:09.729035 (+ 3285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:09.729041 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:09.729045 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:09.729592 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:09.729953 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:09.729957 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:09.729961 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:09.730123 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:09.730713 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:09.730717 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:09.730877 (+ 160us) client_negotiation.cc:769] Sending connection context
0812 11:11:09.731017 (+ 140us) client_negotiation.cc:240] Negotiation successful
0812 11:11:09.731373 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4126,"thread_start_us":3925,"threads_started":1}
I20260812 11:11:09.733494 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 17536
I20260812 11:11:09.733654 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:11:09.734148 4201 external_mini_cluster.cc:1428] Setting key 946c906769788b1ee987b5360079079e
I20260812 11:11:09.737083 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 12 11:11:09 dist-test-slave-rmhg krb5kdc[16833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533069, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 12 11:11:09 dist-test-slave-rmhg krb5kdc[16833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:09 dist-test-slave-rmhg krb5kdc[16833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:11:09.795833 17575 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:09.784291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36590 (local address 127.4.26.126:41881)
0812 11:11:09.784592 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:09.784599 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:09.784777 (+ 178us) server_negotiation.cc:407] Connection header received
0812 11:11:09.784987 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:09.784992 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:09.785086 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:09.785249 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:09.786636 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.787523 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.788899 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.789433 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.789556 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:09.795504 (+ 5948us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36590: BlockingRecv error: recv got EOF from 127.0.0.1:36590 (error 108)
Metrics: {"server-negotiator.queue_time_us":120}
Aug 12 11:11:09 dist-test-slave-rmhg krb5kdc[16833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533069, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM
I20260812 11:11:09.813045 17575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:09.799150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36596 (local address 127.4.26.126:41881)
0812 11:11:09.799392 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:09.799398 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:09.799672 (+ 274us) server_negotiation.cc:407] Connection header received
0812 11:11:09.799845 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:09.799849 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:09.799917 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:09.800000 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:09.801276 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.802018 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.803344 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.803803 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.803952 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:09.807948 (+ 3996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:09.807956 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:09.807960 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:09.808002 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:09.810586 (+ 2584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:09.811283 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:09.811287 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:09.811290 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:09.811420 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:09.811755 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:09.811759 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:09.811761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:09.812066 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:09.812286 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:09.812577 (+ 291us) server_negotiation.cc:299] Negotiation successful
0812 11:11:09.812769 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 11:11:09.817765 16908 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36596:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:11:09.824927 16908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:11:09.863158 17791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:09.840288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:37975 (local address 127.0.0.1:39044)
0812 11:11:09.854483 (+ 14195us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:09.854500 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:09.854724 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:09.855622 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:09.855626 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:09.855648 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:09.856052 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:09.856064 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.857867 (+ 1803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.857873 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:09.859844 (+ 1971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:09.859859 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.862015 (+ 2156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.862022 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:09.862268 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:09.862336 (+ 68us) client_negotiation.cc:769] Sending connection context
0812 11:11:09.862469 (+ 133us) client_negotiation.cc:240] Negotiation successful
0812 11:11:09.862696 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14069,"mutex_wait_us":1,"thread_start_us":13147,"threads_started":1}
I20260812 11:11:09.863386 17799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:09.840566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39044 (local address 127.4.26.66:37975)
0812 11:11:09.852950 (+ 12384us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:09.852963 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:09.854611 (+ 1648us) server_negotiation.cc:407] Connection header received
0812 11:11:09.854910 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:09.854918 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:09.855171 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:09.855338 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:09.856248 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.857754 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.860042 (+ 2288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.861468 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.861604 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:09.861850 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:09.862900 (+ 1050us) server_negotiation.cc:299] Negotiation successful
0812 11:11:09.863099 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12142,"thread_start_us":12423,"threads_started":1}
I20260812 11:11:09.863888 17793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:09.839774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46630 (local address 127.4.26.67:40457)
0812 11:11:09.854262 (+ 14488us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:09.854272 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:09.854313 (+ 41us) server_negotiation.cc:407] Connection header received
0812 11:11:09.854431 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:09.854441 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:09.854765 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:09.854986 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:09.856161 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.858083 (+ 1922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.860795 (+ 2712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.862341 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.862470 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:09.862772 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:09.863268 (+ 496us) server_negotiation.cc:299] Negotiation successful
0812 11:11:09.863474 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14296,"thread_start_us":14097,"threads_started":1}
I20260812 11:11:09.863916 17794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:09.839093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:40457 (local address 127.0.0.1:46630)
0812 11:11:09.853730 (+ 14637us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:09.853755 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:09.853953 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:09.855386 (+ 1433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:09.855393 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:09.855441 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:09.855907 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:09.855921 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.858258 (+ 2337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.858264 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:09.860589 (+ 2325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:09.860606 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.862603 (+ 1997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.862609 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:09.862775 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:09.862808 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 11:11:09.862905 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 11:11:09.863029 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14507,"mutex_wait_us":48,"thread_start_us":15127,"threads_started":1}
I20260812 11:11:09.864696 17789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:09.838840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45829 (local address 127.0.0.1:52574)
0812 11:11:09.839820 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:09.839870 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:09.840047 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:09.857134 (+ 17087us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:09.857139 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:09.857190 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:09.857593 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:09.857605 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.859758 (+ 2153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.859764 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:09.861900 (+ 2136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:09.861917 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.863882 (+ 1965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.863891 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:09.864066 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:09.864099 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 11:11:09.864165 (+ 66us) client_negotiation.cc:240] Negotiation successful
0812 11:11:09.864298 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"mutex_wait_us":1,"thread_start_us":587,"threads_started":1}
I20260812 11:11:09.865824 17790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:09.839045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52574 (local address 127.4.26.65:45829)
0812 11:11:09.856507 (+ 17462us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:09.856515 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:09.856544 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:11:09.856637 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:09.856644 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:09.856887 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:09.857722 (+ 835us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:09.857942 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.859586 (+ 1644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.862124 (+ 2538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:09.863597 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:09.865039 (+ 1442us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:09.865285 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:09.865360 (+ 75us) server_negotiation.cc:299] Negotiation successful
0812 11:11:09.865544 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17301,"thread_start_us":17163,"threads_started":1}
I20260812 11:11:09.867899 17395 tablet_service.cc:1467] Processing CreateTablet for tablet d040b7c31c604e0a8fb0727be4e31bc5 (DEFAULT_TABLE table=test-table [id=58053965a40b4abdb90e5c03d44c92ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:09.868010 17644 tablet_service.cc:1467] Processing CreateTablet for tablet d040b7c31c604e0a8fb0727be4e31bc5 (DEFAULT_TABLE table=test-table [id=58053965a40b4abdb90e5c03d44c92ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:09.869367 17395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d040b7c31c604e0a8fb0727be4e31bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:09.869558 17644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d040b7c31c604e0a8fb0727be4e31bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:09.869861 17134 tablet_service.cc:1467] Processing CreateTablet for tablet d040b7c31c604e0a8fb0727be4e31bc5 (DEFAULT_TABLE table=test-table [id=58053965a40b4abdb90e5c03d44c92ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:09.871418 17134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d040b7c31c604e0a8fb0727be4e31bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:09.881232 17805 tablet_bootstrap.cc:492] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903: Bootstrap starting.
I20260812 11:11:09.884753 17806 tablet_bootstrap.cc:492] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Bootstrap starting.
I20260812 11:11:09.886245 17805 tablet_bootstrap.cc:654] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:09.887544 17807 tablet_bootstrap.cc:492] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9: Bootstrap starting.
I20260812 11:11:09.887715 17805 log.cc:824] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903: Log is configured to *not* fsync() on all Append() calls
I20260812 11:11:09.888830 17806 tablet_bootstrap.cc:654] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:09.890130 17806 log.cc:824] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Log is configured to *not* fsync() on all Append() calls
I20260812 11:11:09.891084 17807 tablet_bootstrap.cc:654] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:09.892143 17805 tablet_bootstrap.cc:492] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903: No bootstrap required, opened a new log
I20260812 11:11:09.892417 17807 log.cc:824] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9: Log is configured to *not* fsync() on all Append() calls
I20260812 11:11:09.892510 17805 ts_tablet_manager.cc:1397] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260812 11:11:09.893546 17806 tablet_bootstrap.cc:492] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: No bootstrap required, opened a new log
I20260812 11:11:09.893826 17806 ts_tablet_manager.cc:1397] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260812 11:11:09.895592 17807 tablet_bootstrap.cc:492] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9: No bootstrap required, opened a new log
I20260812 11:11:09.895864 17807 ts_tablet_manager.cc:1397] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260812 11:11:09.900285 17805 raft_consensus.cc:348] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } }
I20260812 11:11:09.901280 17805 raft_consensus.cc:374] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:09.901403 17805 raft_consensus.cc:729] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3162c6992e8d4637afd98a19c33fc903, State: Initialized, Role: FOLLOWER
I20260812 11:11:09.902173 17805 consensus_queue.cc:260] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } }
I20260812 11:11:09.906373 17806 raft_consensus.cc:348] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } }
I20260812 11:11:09.906770 17807 raft_consensus.cc:348] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } }
I20260812 11:11:09.907111 17806 raft_consensus.cc:374] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:09.907264 17807 raft_consensus.cc:374] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:09.907366 17807 raft_consensus.cc:729] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0affbbc08c5422e8aba5300ecd6fea9, State: Initialized, Role: FOLLOWER
I20260812 11:11:09.907321 17806 raft_consensus.cc:729] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a8dcad2bfd4426ebdb7ab5ed7402e00, State: Initialized, Role: FOLLOWER
I20260812 11:11:09.908304 17806 consensus_queue.cc:260] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } }
I20260812 11:11:09.908345 17807 consensus_queue.cc:260] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } }
I20260812 11:11:09.910597 17805 ts_tablet_manager.cc:1428] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903: Time spent starting tablet: real 0.018s user 0.016s sys 0.000s
I20260812 11:11:09.911078 17532 heartbeater.cc:503] Master 127.4.26.126:41881 was elected leader, sending a full tablet report...
I20260812 11:11:09.916831 17807 ts_tablet_manager.cc:1428] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9: Time spent starting tablet: real 0.021s user 0.018s sys 0.003s
I20260812 11:11:09.920775 17760 heartbeater.cc:503] Master 127.4.26.126:41881 was elected leader, sending a full tablet report...
I20260812 11:11:09.921681 17806 ts_tablet_manager.cc:1428] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Time spent starting tablet: real 0.028s user 0.020s sys 0.005s
W20260812 11:11:09.925489 17533 tablet.cc:2369] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:11:09.976924 17762 tablet.cc:2369] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:11:10.096163 17277 tablet.cc:2369] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:11:10.287330 17811 raft_consensus.cc:482] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:11:10.287822 17811 raft_consensus.cc:504] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } }
I20260812 11:11:10.289752 17811 leader_election.cc:288] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0affbbc08c5422e8aba5300ecd6fea9 (127.4.26.65:45829), 0a8dcad2bfd4426ebdb7ab5ed7402e00 (127.4.26.67:40457)
I20260812 11:11:10.291977 17812 raft_consensus.cc:482] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:11:10.292300 17814 raft_consensus.cc:482] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:11:10.292557 17814 raft_consensus.cc:504] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } }
I20260812 11:11:10.292551 17812 raft_consensus.cc:504] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } }
I20260812 11:11:10.294539 17814 leader_election.cc:288] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0affbbc08c5422e8aba5300ecd6fea9 (127.4.26.65:45829), 3162c6992e8d4637afd98a19c33fc903 (127.4.26.66:37975)
I20260812 11:11:10.299163 17793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:10.290199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:54881 (local address 127.4.26.67:40457)
0812 11:11:10.290391 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:10.290399 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:10.291055 (+ 656us) server_negotiation.cc:407] Connection header received
0812 11:11:10.291284 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:10.291287 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:10.291351 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:10.291448 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:10.292144 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.293102 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.296129 (+ 3027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.297684 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.297811 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:10.297947 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:10.298658 (+ 711us) server_negotiation.cc:299] Negotiation successful
0812 11:11:10.298838 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 11:11:10.300364 17817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:10.290086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:40457 (local address 127.4.26.66:54881)
0812 11:11:10.290924 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:10.290946 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:10.291137 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:10.291492 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:10.291498 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:10.291522 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:10.291923 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:10.291949 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.293259 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.293265 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:10.295860 (+ 2595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:10.295882 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.298205 (+ 2323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.298213 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:10.298425 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:10.298474 (+ 49us) client_negotiation.cc:769] Sending connection context
0812 11:11:10.299721 (+ 1247us) client_negotiation.cc:240] Negotiation successful
0812 11:11:10.299915 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"mutex_wait_us":32,"thread_start_us":489,"threads_started":1}
I20260812 11:11:10.300884 17812 leader_election.cc:288] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a8dcad2bfd4426ebdb7ab5ed7402e00 (127.4.26.67:40457), 3162c6992e8d4637afd98a19c33fc903 (127.4.26.66:37975)
I20260812 11:11:10.309190 17790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:10.290207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:35671 (local address 127.4.26.65:45829)
0812 11:11:10.290403 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:10.290409 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:10.291401 (+ 992us) server_negotiation.cc:407] Connection header received
0812 11:11:10.291562 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:10.291567 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:10.291655 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:10.291746 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:10.292396 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.293554 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.302591 (+ 9037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.304867 (+ 2276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.304989 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:10.305107 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:10.308680 (+ 3573us) server_negotiation.cc:299] Negotiation successful
0812 11:11:10.308861 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 11:11:10.310223 17819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:10.290241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45829 (local address 127.4.26.66:35671)
0812 11:11:10.291283 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:10.291300 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:10.291422 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:10.291790 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:10.291795 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:10.291821 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:10.292213 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:10.292227 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.293726 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.293732 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:10.302013 (+ 8281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:10.302034 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.308159 (+ 6125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.308167 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:10.308437 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:10.308493 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 11:11:10.309559 (+ 1066us) client_negotiation.cc:240] Negotiation successful
0812 11:11:10.309752 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":929,"mutex_wait_us":6130,"thread_start_us":766,"threads_started":1}
I20260812 11:11:10.312691 17799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:10.302050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:47597 (local address 127.4.26.66:37975)
0812 11:11:10.302252 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:10.302258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:10.303075 (+ 817us) server_negotiation.cc:407] Connection header received
0812 11:11:10.303345 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:10.303350 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:10.303423 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:10.303499 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:10.305907 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.307148 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.310194 (+ 3046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.311404 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.311530 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:10.311646 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:10.312273 (+ 627us) server_negotiation.cc:299] Negotiation successful
0812 11:11:10.312423 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 11:11:10.313651 17824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:10.302048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:37975 (local address 127.4.26.67:47597)
0812 11:11:10.302991 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:10.303008 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:10.303180 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:10.303688 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:10.303693 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:10.303717 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:10.304077 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:10.304089 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.307366 (+ 3277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.307373 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:10.309952 (+ 2579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:10.309971 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.311809 (+ 1838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.311817 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:10.312042 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:10.312078 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:11:10.313091 (+ 1013us) client_negotiation.cc:240] Negotiation successful
0812 11:11:10.313271 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":809,"spinlock_wait_cycles":39808,"thread_start_us":3191,"threads_started":1}
I20260812 11:11:10.314767 17443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d040b7c31c604e0a8fb0727be4e31bc5" candidate_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3162c6992e8d4637afd98a19c33fc903" is_pre_election: true
I20260812 11:11:10.314953 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d040b7c31c604e0a8fb0727be4e31bc5" candidate_uuid: "3162c6992e8d4637afd98a19c33fc903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" is_pre_election: true
I20260812 11:11:10.315308 17443 raft_consensus.cc:2454] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a8dcad2bfd4426ebdb7ab5ed7402e00 in term 0.
I20260812 11:11:10.315490 17677 raft_consensus.cc:2454] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3162c6992e8d4637afd98a19c33fc903 in term 0.
I20260812 11:11:10.315497 17793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:10.295794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:53883 (local address 127.4.26.67:40457)
0812 11:11:10.299454 (+ 3660us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:10.299460 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:10.301607 (+ 2147us) server_negotiation.cc:407] Connection header received
0812 11:11:10.301892 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:10.301897 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:10.301982 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:10.302044 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:10.304274 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.305702 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.312191 (+ 6489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.314357 (+ 2166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.314507 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:10.314605 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:10.315019 (+ 414us) server_negotiation.cc:299] Negotiation successful
0812 11:11:10.315185 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":778,"server-negotiator.queue_time_us":3530,"thread_start_us":18246,"threads_started":1}
I20260812 11:11:10.316090 17563 leader_election.cc:302] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a8dcad2bfd4426ebdb7ab5ed7402e00, 3162c6992e8d4637afd98a19c33fc903; no voters:
I20260812 11:11:10.316474 17821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:10.295340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:40457 (local address 127.4.26.65:53883)
0812 11:11:10.301503 (+ 6163us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:10.301526 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:10.301745 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:10.302298 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:10.302307 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:10.302338 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:10.304120 (+ 1782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:10.304142 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.306983 (+ 2841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.306990 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:10.311961 (+ 4971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:10.311981 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.314594 (+ 2613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.314603 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:10.314791 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:10.314829 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 11:11:10.315538 (+ 709us) client_negotiation.cc:240] Negotiation successful
0812 11:11:10.315806 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5998,"mutex_wait_us":1332,"thread_start_us":5764,"threads_started":1}
I20260812 11:11:10.316658 17814 raft_consensus.cc:2781] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:11:10.316615 17316 leader_election.cc:302] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a8dcad2bfd4426ebdb7ab5ed7402e00, 3162c6992e8d4637afd98a19c33fc903; no voters:
I20260812 11:11:10.316816 17814 raft_consensus.cc:482] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:11:10.316910 17814 raft_consensus.cc:3037] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:10.317505 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d040b7c31c604e0a8fb0727be4e31bc5" candidate_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" is_pre_election: true
I20260812 11:11:10.317935 17822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:10.295641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:42091 (local address 127.4.26.65:45829)
0812 11:11:10.302769 (+ 7128us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:10.302774 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:10.302802 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:11:10.302863 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:10.302868 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:10.302946 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:10.303562 (+ 616us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:10.305300 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.306648 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.310946 (+ 4298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.312355 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.315167 (+ 2812us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:10.315399 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:10.315529 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 11:11:10.317545 (+ 2016us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":6998,"thread_start_us":6780,"threads_started":1}
I20260812 11:11:10.316253 17820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:10.295066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45829 (local address 127.4.26.67:42091)
0812 11:11:10.301678 (+ 6612us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:10.301696 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:10.301798 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:10.303112 (+ 1314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:10.303117 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:10.303179 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:10.303410 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:10.303422 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.308232 (+ 4810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.308237 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:10.310718 (+ 2481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:10.310736 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.312612 (+ 1876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.312619 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:10.313035 (+ 416us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:10.313073 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 11:11:10.313145 (+ 72us) client_negotiation.cc:240] Negotiation successful
0812 11:11:10.313294 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6511,"mutex_wait_us":3,"spinlock_wait_cycles":16000,"thread_start_us":6388,"threads_started":1}
I20260812 11:11:10.318502 17811 raft_consensus.cc:2781] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:11:10.318691 17811 raft_consensus.cc:482] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:11:10.318799 17811 raft_consensus.cc:3037] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:10.319526 17172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d040b7c31c604e0a8fb0727be4e31bc5" candidate_uuid: "3162c6992e8d4637afd98a19c33fc903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" is_pre_election: true
I20260812 11:11:10.320052 17172 raft_consensus.cc:2454] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3162c6992e8d4637afd98a19c33fc903 in term 0.
I20260812 11:11:10.321316 17814 raft_consensus.cc:504] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } }
I20260812 11:11:10.321779 17677 raft_consensus.cc:2379] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0affbbc08c5422e8aba5300ecd6fea9 in current term 1: Already voted for candidate 0a8dcad2bfd4426ebdb7ab5ed7402e00 in this term.
I20260812 11:11:10.322283 17811 raft_consensus.cc:504] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } }
I20260812 11:11:10.322412 17172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d040b7c31c604e0a8fb0727be4e31bc5" candidate_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" is_pre_election: true
I20260812 11:11:10.322621 17172 raft_consensus.cc:2454] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a8dcad2bfd4426ebdb7ab5ed7402e00 in term 0.
I20260812 11:11:10.323246 17811 leader_election.cc:288] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [CANDIDATE]: Term 1 election: Requested vote from peers c0affbbc08c5422e8aba5300ecd6fea9 (127.4.26.65:45829), 0a8dcad2bfd4426ebdb7ab5ed7402e00 (127.4.26.67:40457)
I20260812 11:11:10.323706 17799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:10.303783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:60067 (local address 127.4.26.66:37975)
0812 11:11:10.312974 (+ 9191us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:10.312980 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:10.314472 (+ 1492us) server_negotiation.cc:407] Connection header received
0812 11:11:10.315888 (+ 1416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:10.315893 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:10.315985 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:10.316047 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:10.317347 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.318505 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.321076 (+ 2571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.322382 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.322556 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:10.322667 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:10.323255 (+ 588us) server_negotiation.cc:299] Negotiation successful
0812 11:11:10.323404 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9070,"thread_start_us":14697,"threads_started":1}
I20260812 11:11:10.323742 17814 leader_election.cc:288] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [CANDIDATE]: Term 1 election: Requested vote from peers c0affbbc08c5422e8aba5300ecd6fea9 (127.4.26.65:45829), 3162c6992e8d4637afd98a19c33fc903 (127.4.26.66:37975)
I20260812 11:11:10.323942 17172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d040b7c31c604e0a8fb0727be4e31bc5" candidate_uuid: "3162c6992e8d4637afd98a19c33fc903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0affbbc08c5422e8aba5300ecd6fea9"
I20260812 11:11:10.324184 17172 raft_consensus.cc:3037] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:10.324566 17829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:10.304484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:37975 (local address 127.4.26.65:60067)
0812 11:11:10.314361 (+ 9877us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:10.314382 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:10.315724 (+ 1342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:10.316258 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:10.316263 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:10.316292 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:10.316809 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:10.316824 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.318675 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.318681 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:10.320852 (+ 2171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:10.320872 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.322844 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.322852 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:10.323046 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:10.323083 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:11:10.323876 (+ 793us) client_negotiation.cc:240] Negotiation successful
0812 11:11:10.324044 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9738,"thread_start_us":16544,"threads_started":1}
I20260812 11:11:10.324642 17443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d040b7c31c604e0a8fb0727be4e31bc5" candidate_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3162c6992e8d4637afd98a19c33fc903"
I20260812 11:11:10.324915 17443 raft_consensus.cc:2379] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0a8dcad2bfd4426ebdb7ab5ed7402e00 in current term 1: Already voted for candidate 3162c6992e8d4637afd98a19c33fc903 in this term.
I20260812 11:11:10.325189 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d040b7c31c604e0a8fb0727be4e31bc5" candidate_uuid: "3162c6992e8d4637afd98a19c33fc903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00"
I20260812 11:11:10.325445 17677 raft_consensus.cc:2379] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3162c6992e8d4637afd98a19c33fc903 in current term 1: Already voted for candidate 0a8dcad2bfd4426ebdb7ab5ed7402e00 in this term.
I20260812 11:11:10.325502 17431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d040b7c31c604e0a8fb0727be4e31bc5" candidate_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3162c6992e8d4637afd98a19c33fc903" is_pre_election: true
I20260812 11:11:10.325628 17170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d040b7c31c604e0a8fb0727be4e31bc5" candidate_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0affbbc08c5422e8aba5300ecd6fea9"
I20260812 11:11:10.325860 17431 raft_consensus.cc:2379] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0affbbc08c5422e8aba5300ecd6fea9 in current term 1: Already voted for candidate 3162c6992e8d4637afd98a19c33fc903 in this term.
I20260812 11:11:10.326357 17563 leader_election.cc:302] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a8dcad2bfd4426ebdb7ab5ed7402e00; no voters: 3162c6992e8d4637afd98a19c33fc903, c0affbbc08c5422e8aba5300ecd6fea9
I20260812 11:11:10.326449 17052 leader_election.cc:302] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0affbbc08c5422e8aba5300ecd6fea9; no voters: 0a8dcad2bfd4426ebdb7ab5ed7402e00, 3162c6992e8d4637afd98a19c33fc903
I20260812 11:11:10.327160 17814 raft_consensus.cc:2726] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 11:11:10.328028 17172 raft_consensus.cc:2454] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3162c6992e8d4637afd98a19c33fc903 in term 1.
I20260812 11:11:10.328203 17812 raft_consensus.cc:2726] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 11:11:10.328482 17315 leader_election.cc:302] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3162c6992e8d4637afd98a19c33fc903, c0affbbc08c5422e8aba5300ecd6fea9; no voters: 0a8dcad2bfd4426ebdb7ab5ed7402e00
I20260812 11:11:10.328848 17811 raft_consensus.cc:2781] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:11:10.329370 17811 raft_consensus.cc:686] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [term 1 LEADER]: Becoming Leader. State: Replica: 3162c6992e8d4637afd98a19c33fc903, State: Running, Role: LEADER
I20260812 11:11:10.329854 17811 consensus_queue.cc:237] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } }
I20260812 11:11:10.334527 16908 catalog_manager.cc:5495] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3162c6992e8d4637afd98a19c33fc903 (127.4.26.66). New cstate: current_term: 1 leader_uuid: "3162c6992e8d4637afd98a19c33fc903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } health_report { overall_health: HEALTHY } } }
I20260812 11:11:10.441640 17799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:10.435783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39052 (local address 127.4.26.66:37975)
0812 11:11:10.435950 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:10.435954 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:10.436374 (+ 420us) server_negotiation.cc:407] Connection header received
0812 11:11:10.436561 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:10.436565 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:10.436677 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:10.436806 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:11:10.437249 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.437967 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.439329 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:10.439740 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:10.439830 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:10.440285 (+ 455us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:11:10.440995 (+ 710us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:11:10.441130 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:10.441331 (+ 201us) server_negotiation.cc:299] Negotiation successful
0812 11:11:10.441411 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:11:10.450205 17677 raft_consensus.cc:1261] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Refusing update from remote peer 3162c6992e8d4637afd98a19c33fc903: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:11:10.450196 17172 raft_consensus.cc:1261] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Refusing update from remote peer 3162c6992e8d4637afd98a19c33fc903: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:11:10.451231 17811 consensus_queue.cc:1035] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:11:10.451725 17831 consensus_queue.cc:1035] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:11:10.466492 17854 mvcc.cc:205] Tried to move back new op lower bound from 7317639456552644608 to 7317639456074928128. Current Snapshot: MvccSnapshot[applied={T|T < 7317639456552644608}]
I20260812 11:11:10.484746 16908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36596:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:11:10.484992 16908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36596:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:11:10.488739 16908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c: Sending DeleteTablet for 3 replicas of tablet d040b7c31c604e0a8fb0727be4e31bc5
I20260812 11:11:10.490114 17644 tablet_service.cc:1514] Processing DeleteTablet for tablet d040b7c31c604e0a8fb0727be4e31bc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:10 UTC) from {username='oryx', principal='oryx/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:46630
I20260812 11:11:10.490195 17134 tablet_service.cc:1514] Processing DeleteTablet for tablet d040b7c31c604e0a8fb0727be4e31bc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:10 UTC) from {username='oryx', principal='oryx/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:52574
I20260812 11:11:10.491608 17395 tablet_service.cc:1514] Processing DeleteTablet for tablet d040b7c31c604e0a8fb0727be4e31bc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:10 UTC) from {username='oryx', principal='oryx/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:39044
I20260812 11:11:10.496209 16908 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36596:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:11:10.498430 16908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:11:10.500933 17865 tablet_replica.cc:330] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9: stopping tablet replica
I20260812 11:11:10.501713 17865 raft_consensus.cc:2229] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:11:10.502409 17865 raft_consensus.cc:2258] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:10.504778 17865 ts_tablet_manager.cc:1905] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:10.509732 17134 tablet_service.cc:1467] Processing CreateTablet for tablet 9c85bd8bd5154930ae5c9e391b8a4e3c (DEFAULT_TABLE table=test-table [id=97b2ee3f947e463d99460f141ced86e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:10.510241 17134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c85bd8bd5154930ae5c9e391b8a4e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:10.510342 17394 tablet_service.cc:1467] Processing CreateTablet for tablet 9c85bd8bd5154930ae5c9e391b8a4e3c (DEFAULT_TABLE table=test-table [id=97b2ee3f947e463d99460f141ced86e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:10.511021 17394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c85bd8bd5154930ae5c9e391b8a4e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:10.510538 17644 tablet_service.cc:1467] Processing CreateTablet for tablet 9c85bd8bd5154930ae5c9e391b8a4e3c (DEFAULT_TABLE table=test-table [id=97b2ee3f947e463d99460f141ced86e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:10.518164 17644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c85bd8bd5154930ae5c9e391b8a4e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:10.519694 17866 tablet_replica.cc:330] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903: stopping tablet replica
I20260812 11:11:10.507551 17864 tablet_replica.cc:330] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: stopping tablet replica
I20260812 11:11:10.520283 17866 raft_consensus.cc:2229] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:11:10.520897 17864 raft_consensus.cc:2229] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:11:10.521070 17866 raft_consensus.cc:2258] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:10.523689 17864 raft_consensus.cc:2258] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:10.525465 17865 ts_tablet_manager.cc:1918] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:11:10.525700 17865 log.cc:1196] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/d040b7c31c604e0a8fb0727be4e31bc5
I20260812 11:11:10.526294 17865 ts_tablet_manager.cc:1939] T d040b7c31c604e0a8fb0727be4e31bc5 P c0affbbc08c5422e8aba5300ecd6fea9: Deleting consensus metadata
I20260812 11:11:10.526702 17868 tablet_bootstrap.cc:492] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903: Bootstrap starting.
I20260812 11:11:10.527751 17867 tablet_bootstrap.cc:492] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9: Bootstrap starting.
I20260812 11:11:10.527813 17866 ts_tablet_manager.cc:1905] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:10.528384 16881 catalog_manager.cc:4841] TS c0affbbc08c5422e8aba5300ecd6fea9 (127.4.26.65:45829): tablet d040b7c31c604e0a8fb0727be4e31bc5 (table test-table [id=58053965a40b4abdb90e5c03d44c92ff]) successfully deleted
I20260812 11:11:10.528901 17868 tablet_bootstrap.cc:654] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:10.530053 17867 tablet_bootstrap.cc:654] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:10.532720 17864 ts_tablet_manager.cc:1905] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:10.536608 17866 ts_tablet_manager.cc:1918] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:11:10.536849 17866 log.cc:1196] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/d040b7c31c604e0a8fb0727be4e31bc5
I20260812 11:11:10.537518 17866 ts_tablet_manager.cc:1939] T d040b7c31c604e0a8fb0727be4e31bc5 P 3162c6992e8d4637afd98a19c33fc903: Deleting consensus metadata
I20260812 11:11:10.539420 17872 tablet_bootstrap.cc:492] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Bootstrap starting.
I20260812 11:11:10.539506 16881 catalog_manager.cc:4841] TS 3162c6992e8d4637afd98a19c33fc903 (127.4.26.66:37975): tablet d040b7c31c604e0a8fb0727be4e31bc5 (table test-table [id=58053965a40b4abdb90e5c03d44c92ff]) successfully deleted
I20260812 11:11:10.540534 17867 tablet_bootstrap.cc:492] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9: No bootstrap required, opened a new log
I20260812 11:11:10.540721 17867 ts_tablet_manager.cc:1397] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.007s
I20260812 11:11:10.541764 17868 tablet_bootstrap.cc:492] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903: No bootstrap required, opened a new log
I20260812 11:11:10.541671 17867 raft_consensus.cc:348] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:10.541941 17867 raft_consensus.cc:374] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:10.542047 17867 raft_consensus.cc:729] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0affbbc08c5422e8aba5300ecd6fea9, State: Initialized, Role: FOLLOWER
I20260812 11:11:10.542222 17868 ts_tablet_manager.cc:1397] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.001s
I20260812 11:11:10.542338 17867 consensus_queue.cc:260] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:10.542961 17872 tablet_bootstrap.cc:654] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:10.543399 17868 raft_consensus.cc:348] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:10.543764 17868 raft_consensus.cc:374] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:10.539942 17864 ts_tablet_manager.cc:1918] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:11:10.543933 17868 raft_consensus.cc:729] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3162c6992e8d4637afd98a19c33fc903, State: Initialized, Role: FOLLOWER
I20260812 11:11:10.544083 17864 log.cc:1196] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/d040b7c31c604e0a8fb0727be4e31bc5
I20260812 11:11:10.544412 17868 consensus_queue.cc:260] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:10.544648 17864 ts_tablet_manager.cc:1939] T d040b7c31c604e0a8fb0727be4e31bc5 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Deleting consensus metadata
I20260812 11:11:10.546139 17868 ts_tablet_manager.cc:1428] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260812 11:11:10.546638 16882 catalog_manager.cc:4841] TS 0a8dcad2bfd4426ebdb7ab5ed7402e00 (127.4.26.67:40457): tablet d040b7c31c604e0a8fb0727be4e31bc5 (table test-table [id=58053965a40b4abdb90e5c03d44c92ff]) successfully deleted
I20260812 11:11:10.548286 17867 ts_tablet_manager.cc:1428] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260812 11:11:10.548995 17872 tablet_bootstrap.cc:492] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00: No bootstrap required, opened a new log
I20260812 11:11:10.549238 17872 ts_tablet_manager.cc:1397] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20260812 11:11:10.550066 17872 raft_consensus.cc:348] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:10.550396 17872 raft_consensus.cc:374] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:10.550518 17872 raft_consensus.cc:729] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a8dcad2bfd4426ebdb7ab5ed7402e00, State: Initialized, Role: FOLLOWER
I20260812 11:11:10.550814 17872 consensus_queue.cc:260] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:10.551478 17872 ts_tablet_manager.cc:1428] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260812 11:11:10.877501 17859 raft_consensus.cc:482] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:11:10.877768 17859 raft_consensus.cc:504] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:10.878736 17859 leader_election.cc:288] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0affbbc08c5422e8aba5300ecd6fea9 (127.4.26.65:45829), 0a8dcad2bfd4426ebdb7ab5ed7402e00 (127.4.26.67:40457)
I20260812 11:11:10.879338 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c85bd8bd5154930ae5c9e391b8a4e3c" candidate_uuid: "3162c6992e8d4637afd98a19c33fc903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" is_pre_election: true
I20260812 11:11:10.879347 17172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c85bd8bd5154930ae5c9e391b8a4e3c" candidate_uuid: "3162c6992e8d4637afd98a19c33fc903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" is_pre_election: true
I20260812 11:11:10.879580 17677 raft_consensus.cc:2454] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3162c6992e8d4637afd98a19c33fc903 in term 0.
I20260812 11:11:10.879621 17172 raft_consensus.cc:2454] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3162c6992e8d4637afd98a19c33fc903 in term 0.
I20260812 11:11:10.880082 17316 leader_election.cc:302] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a8dcad2bfd4426ebdb7ab5ed7402e00, 3162c6992e8d4637afd98a19c33fc903; no voters:
I20260812 11:11:10.880437 17859 raft_consensus.cc:2781] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:11:10.880564 17859 raft_consensus.cc:482] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:11:10.880677 17859 raft_consensus.cc:3037] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:10.883476 17859 raft_consensus.cc:504] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:10.884115 17859 leader_election.cc:288] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [CANDIDATE]: Term 1 election: Requested vote from peers c0affbbc08c5422e8aba5300ecd6fea9 (127.4.26.65:45829), 0a8dcad2bfd4426ebdb7ab5ed7402e00 (127.4.26.67:40457)
I20260812 11:11:10.884658 17172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c85bd8bd5154930ae5c9e391b8a4e3c" candidate_uuid: "3162c6992e8d4637afd98a19c33fc903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0affbbc08c5422e8aba5300ecd6fea9"
I20260812 11:11:10.884732 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c85bd8bd5154930ae5c9e391b8a4e3c" candidate_uuid: "3162c6992e8d4637afd98a19c33fc903" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00"
I20260812 11:11:10.884929 17172 raft_consensus.cc:3037] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:10.884951 17677 raft_consensus.cc:3037] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:10.887970 17677 raft_consensus.cc:2454] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3162c6992e8d4637afd98a19c33fc903 in term 1.
I20260812 11:11:10.887985 17172 raft_consensus.cc:2454] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3162c6992e8d4637afd98a19c33fc903 in term 1.
I20260812 11:11:10.888568 17315 leader_election.cc:302] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3162c6992e8d4637afd98a19c33fc903, c0affbbc08c5422e8aba5300ecd6fea9; no voters:
I20260812 11:11:10.889046 17859 raft_consensus.cc:2781] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:11:10.889219 17859 raft_consensus.cc:686] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [term 1 LEADER]: Becoming Leader. State: Replica: 3162c6992e8d4637afd98a19c33fc903, State: Running, Role: LEADER
I20260812 11:11:10.889531 17859 consensus_queue.cc:237] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:10.892408 16909 catalog_manager.cc:5495] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3162c6992e8d4637afd98a19c33fc903 (127.4.26.66). New cstate: current_term: 1 leader_uuid: "3162c6992e8d4637afd98a19c33fc903" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } health_report { overall_health: UNKNOWN } } }
Aug 12 11:11:11 dist-test-slave-rmhg krb5kdc[16833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533067, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.126@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM
I20260812 11:11:11.026489 17892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:11.008045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41881 (local address 127.0.0.1:36604)
0812 11:11:11.008924 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:11.008942 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:11.009101 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:11.009506 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:11.009509 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:11.010210 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:11.010430 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:11.010440 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.011520 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.011524 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:11.012506 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:11.012519 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.013280 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.013285 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:11.013421 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:11.018004 (+ 4583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:11.018030 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:11.020555 (+ 2525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:11.023938 (+ 3383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:11.023955 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:11.023963 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:11.024450 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:11.024811 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:11.024815 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:11.024817 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:11.024948 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:11.025623 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:11.025631 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:11.025789 (+ 158us) client_negotiation.cc:769] Sending connection context
0812 11:11:11.025948 (+ 159us) client_negotiation.cc:240] Negotiation successful
0812 11:11:11.026187 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":745,"thread_start_us":553,"threads_started":1}
I20260812 11:11:11.026593 17888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:11.008048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36604 (local address 127.4.26.126:41881)
0812 11:11:11.008854 (+ 806us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:11.008859 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:11.009076 (+ 217us) server_negotiation.cc:407] Connection header received
0812 11:11:11.009250 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:11.009254 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:11.009330 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:11.009432 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:11.010583 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.011392 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.012633 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.013087 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.013212 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:11.020871 (+ 7659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:11.020878 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:11.020882 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:11.020923 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:11.023765 (+ 2842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:11.024581 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:11.024586 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:11.024588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:11.024723 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:11.025076 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:11.025081 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:11.025083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:11.025500 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:11.025628 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:11.026085 (+ 457us) server_negotiation.cc:299] Negotiation successful
0812 11:11:11.026307 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":670,"thread_start_us":322,"threads_started":1}
I20260812 11:11:11.031880 16909 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:36604:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260812 11:11:11.032980 16909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:11:11.040099 17394 tablet_service.cc:1467] Processing CreateTablet for tablet 6126d2de20414d949f4b116ad9f05ff3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4141f80cc39848a1bebf914d24f04762]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:11:11.040099 17134 tablet_service.cc:1467] Processing CreateTablet for tablet 6126d2de20414d949f4b116ad9f05ff3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4141f80cc39848a1bebf914d24f04762]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:11:11.040254 17644 tablet_service.cc:1467] Processing CreateTablet for tablet 6126d2de20414d949f4b116ad9f05ff3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4141f80cc39848a1bebf914d24f04762]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 11:11:11.040669 17394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6126d2de20414d949f4b116ad9f05ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:11.040683 17134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6126d2de20414d949f4b116ad9f05ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:11.040722 17644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6126d2de20414d949f4b116ad9f05ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:11.046057 17868 tablet_bootstrap.cc:492] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903: Bootstrap starting.
I20260812 11:11:11.047930 17868 tablet_bootstrap.cc:654] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:11.048240 17867 tablet_bootstrap.cc:492] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9: Bootstrap starting.
I20260812 11:11:11.048941 17872 tablet_bootstrap.cc:492] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Bootstrap starting.
I20260812 11:11:11.050002 17867 tablet_bootstrap.cc:654] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:11.050701 17872 tablet_bootstrap.cc:654] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:11.052165 17867 tablet_bootstrap.cc:492] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9: No bootstrap required, opened a new log
I20260812 11:11:11.052397 17867 ts_tablet_manager.cc:1397] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260812 11:11:11.052927 17868 tablet_bootstrap.cc:492] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903: No bootstrap required, opened a new log
I20260812 11:11:11.053112 17868 ts_tablet_manager.cc:1397] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260812 11:11:11.053114 17867 raft_consensus.cc:348] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.053438 17867 raft_consensus.cc:374] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:11.053524 17867 raft_consensus.cc:729] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0affbbc08c5422e8aba5300ecd6fea9, State: Initialized, Role: FOLLOWER
I20260812 11:11:11.053814 17867 consensus_queue.cc:260] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.053943 17868 raft_consensus.cc:348] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.054379 17868 raft_consensus.cc:374] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:11.054461 17868 raft_consensus.cc:729] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3162c6992e8d4637afd98a19c33fc903, State: Initialized, Role: FOLLOWER
I20260812 11:11:11.054653 17867 ts_tablet_manager.cc:1428] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260812 11:11:11.054716 17868 consensus_queue.cc:260] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.055169 17859 tablet_replica.cc:439] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } }
I20260812 11:11:11.055490 17859 tablet_replica.cc:442] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:11:11.055497 17868 ts_tablet_manager.cc:1428] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:11:11.055315 17903 tablet_replica.cc:439] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } }
I20260812 11:11:11.055790 17903 tablet_replica.cc:442] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:11:11.060340 17872 tablet_bootstrap.cc:492] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: No bootstrap required, opened a new log
I20260812 11:11:11.060527 17872 ts_tablet_manager.cc:1397] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260812 11:11:11.061239 17872 raft_consensus.cc:348] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.061496 17872 raft_consensus.cc:374] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:11.061592 17872 raft_consensus.cc:729] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a8dcad2bfd4426ebdb7ab5ed7402e00, State: Initialized, Role: FOLLOWER
I20260812 11:11:11.061847 17872 consensus_queue.cc:260] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.062644 17872 ts_tablet_manager.cc:1428] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260812 11:11:11.062595 17904 tablet_replica.cc:439] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } }
I20260812 11:11:11.062898 17904 tablet_replica.cc:442] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:11:11.259714 17903 raft_consensus.cc:482] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:11:11.259954 17903 raft_consensus.cc:504] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.260659 17903 leader_election.cc:288] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3162c6992e8d4637afd98a19c33fc903 (127.4.26.66:37975), 0a8dcad2bfd4426ebdb7ab5ed7402e00 (127.4.26.67:40457)
I20260812 11:11:11.261341 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6126d2de20414d949f4b116ad9f05ff3" candidate_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" is_pre_election: true
I20260812 11:11:11.261365 17431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6126d2de20414d949f4b116ad9f05ff3" candidate_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3162c6992e8d4637afd98a19c33fc903" is_pre_election: true
I20260812 11:11:11.261580 17677 raft_consensus.cc:2454] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0affbbc08c5422e8aba5300ecd6fea9 in term 0.
I20260812 11:11:11.261581 17431 raft_consensus.cc:2454] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0affbbc08c5422e8aba5300ecd6fea9 in term 0.
I20260812 11:11:11.262090 17053 leader_election.cc:302] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0a8dcad2bfd4426ebdb7ab5ed7402e00, 3162c6992e8d4637afd98a19c33fc903, c0affbbc08c5422e8aba5300ecd6fea9; no voters:
I20260812 11:11:11.262410 17903 raft_consensus.cc:2781] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:11:11.262521 17903 raft_consensus.cc:482] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:11:11.262607 17903 raft_consensus.cc:3037] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:11.264858 17903 raft_consensus.cc:504] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.265528 17903 leader_election.cc:288] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [CANDIDATE]: Term 1 election: Requested vote from peers 3162c6992e8d4637afd98a19c33fc903 (127.4.26.66:37975), 0a8dcad2bfd4426ebdb7ab5ed7402e00 (127.4.26.67:40457)
I20260812 11:11:11.266103 17431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6126d2de20414d949f4b116ad9f05ff3" candidate_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3162c6992e8d4637afd98a19c33fc903"
I20260812 11:11:11.266144 17677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6126d2de20414d949f4b116ad9f05ff3" candidate_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00"
I20260812 11:11:11.266381 17677 raft_consensus.cc:3037] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:11.266382 17431 raft_consensus.cc:3037] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:11.269466 17431 raft_consensus.cc:2454] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0affbbc08c5422e8aba5300ecd6fea9 in term 1.
I20260812 11:11:11.269469 17677 raft_consensus.cc:2454] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0affbbc08c5422e8aba5300ecd6fea9 in term 1.
I20260812 11:11:11.270017 17053 leader_election.cc:302] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0a8dcad2bfd4426ebdb7ab5ed7402e00, 3162c6992e8d4637afd98a19c33fc903, c0affbbc08c5422e8aba5300ecd6fea9; no voters:
I20260812 11:11:11.270373 17903 raft_consensus.cc:2781] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:11:11.270821 17903 raft_consensus.cc:686] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 LEADER]: Becoming Leader. State: Replica: c0affbbc08c5422e8aba5300ecd6fea9, State: Running, Role: LEADER
I20260812 11:11:11.271230 17903 consensus_queue.cc:237] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.273085 17906 tablet_replica.cc:439] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9: TxnStatusTablet state changed. Reason: New leader c0affbbc08c5422e8aba5300ecd6fea9. Latest consensus state: current_term: 1 leader_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } }
I20260812 11:11:11.273407 17906 tablet_replica.cc:442] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:11:11.274119 17910 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260812 11:11:11.274340 17910 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260812 11:11:11.275046 16903 catalog_manager.cc:5495] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0affbbc08c5422e8aba5300ecd6fea9 (127.4.26.65). New cstate: current_term: 1 leader_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } health_report { overall_health: UNKNOWN } } }
I20260812 11:11:11.303143 17892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:11.296646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45829 (local address 127.0.0.1:52582)
0812 11:11:11.296896 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:11.296921 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:11.297104 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:11.297844 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:11.297849 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:11.297862 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:11:11.298069 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:11.298079 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.299238 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.299245 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:11.300276 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:11.300290 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.301132 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.301140 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:11.301359 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:11.301441 (+ 82us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:11:11.302492 (+ 1051us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:11:11.302530 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 11:11:11.302627 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 11:11:11.302817 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 11:11:11.303222 17913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:11.296657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52582 (local address 127.4.26.65:45829)
0812 11:11:11.297431 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:11.297436 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:11.297456 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:11:11.297541 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:11.297545 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:11.297649 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:11.297820 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:11:11.298234 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.299089 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.300442 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.300953 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.301082 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:11.301683 (+ 601us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:11:11.302365 (+ 682us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:11:11.302554 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:11.302690 (+ 136us) server_negotiation.cc:299] Negotiation successful
0812 11:11:11.302790 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":423,"threads_started":1}
I20260812 11:11:11.308789 17677 raft_consensus.cc:1261] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Refusing update from remote peer c0affbbc08c5422e8aba5300ecd6fea9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:11:11.309134 17431 raft_consensus.cc:1261] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Refusing update from remote peer c0affbbc08c5422e8aba5300ecd6fea9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:11:11.309656 17903 consensus_queue.cc:1035] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:11:11.310083 17906 consensus_queue.cc:1035] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:11:11.318466 17859 tablet_replica.cc:439] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903: TxnStatusTablet state changed. Reason: New leader c0affbbc08c5422e8aba5300ecd6fea9. Latest consensus state: current_term: 1 leader_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } }
I20260812 11:11:11.318840 17859 tablet_replica.cc:442] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:11:11.319199 17904 tablet_replica.cc:439] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: TxnStatusTablet state changed. Reason: New leader c0affbbc08c5422e8aba5300ecd6fea9. Latest consensus state: current_term: 1 leader_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } }
I20260812 11:11:11.319478 17904 tablet_replica.cc:442] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:11:11.328107 17917 mvcc.cc:205] Tried to move back new op lower bound from 7317639460071530496 to 7317639459930546176. Current Snapshot: MvccSnapshot[applied={T|T < 7317639460071530496}]
I20260812 11:11:11.330582 17859 tablet_replica.cc:439] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } }
I20260812 11:11:11.330929 17859 tablet_replica.cc:442] T 6126d2de20414d949f4b116ad9f05ff3 P 3162c6992e8d4637afd98a19c33fc903: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:11:11.331306 17914 mvcc.cc:205] Tried to move back new op lower bound from 7317639460071530496 to 7317639459930546176. Current Snapshot: MvccSnapshot[applied={T|T < 7317639460071530496}]
I20260812 11:11:11.334203 17903 tablet_replica.cc:439] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } }
I20260812 11:11:11.334525 17903 tablet_replica.cc:442] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:11:11.334918 17903 tablet_replica.cc:439] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } }
I20260812 11:11:11.335170 17903 tablet_replica.cc:442] T 6126d2de20414d949f4b116ad9f05ff3 P c0affbbc08c5422e8aba5300ecd6fea9: This TxnStatusTablet replica's current role is: LEADER
I20260812 11:11:11.340061 17904 tablet_replica.cc:439] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } } }
I20260812 11:11:11.340334 17904 tablet_replica.cc:442] T 6126d2de20414d949f4b116ad9f05ff3 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 11:11:11.356004 17913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:11.350105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:41627 (local address 127.4.26.65:45829)
0812 11:11:11.350375 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:11.350380 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:11.350449 (+ 69us) server_negotiation.cc:407] Connection header received
0812 11:11:11.350723 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:11.350727 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:11.350798 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:11.350881 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:11:11.351408 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.352290 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.354294 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.354739 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.354831 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:11.355362 (+ 531us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:11:11.355468 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:11:11.355531 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:11.355688 (+ 157us) server_negotiation.cc:299] Negotiation successful
0812 11:11:11.355761 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162}
I20260812 11:11:11.356204 17930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:11.349697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45829 (local address 127.4.26.66:41627)
0812 11:11:11.350359 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:11.350382 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:11.350575 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:11.350911 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:11.350916 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:11.350929 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:11:11.351239 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:11.351252 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.352424 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.352431 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:11.354151 (+ 1720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:11.354170 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.354912 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.354919 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:11.355105 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:11.355187 (+ 82us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:11:11.355551 (+ 364us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:11:11.355563 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 11:11:11.355649 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 11:11:11.355809 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":298,"threads_started":1}
I20260812 11:11:11.365978 17172 raft_consensus.cc:1261] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Refusing update from remote peer 3162c6992e8d4637afd98a19c33fc903: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:11:11.365991 17677 raft_consensus.cc:1261] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Refusing update from remote peer 3162c6992e8d4637afd98a19c33fc903: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:11:11.366562 17811 consensus_queue.cc:1035] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:11:11.366865 17859 consensus_queue.cc:1035] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:11:11.411839 17941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:11.403229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:36637 (local address 127.4.26.66:37975)
0812 11:11:11.403871 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:11.403877 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:11.404274 (+ 397us) server_negotiation.cc:407] Connection header received
0812 11:11:11.404480 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:11.404486 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:11.404577 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:11.404669 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:11:11.405677 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.406852 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.409195 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.409919 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.410045 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:11.410762 (+ 717us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:11:11.410924 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:11:11.411020 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:11.411336 (+ 316us) server_negotiation.cc:299] Negotiation successful
0812 11:11:11.411423 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":339,"threads_started":1}
I20260812 11:11:11.411849 17944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:11.403179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:37975 (local address 127.4.26.65:36637)
0812 11:11:11.404161 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:11.404178 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:11.404336 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:11.405136 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:11.405139 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:11.405176 (+ 37us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:11:11.405482 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:11.405491 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.406999 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.407005 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:11.408963 (+ 1958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:11.408983 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.410193 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.410201 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:11.410402 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:11.410489 (+ 87us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:11:11.411193 (+ 704us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:11:11.411205 (+ 12us) client_negotiation.cc:769] Sending connection context
0812 11:11:11.411297 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 11:11:11.411458 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":779,"thread_start_us":594,"threads_started":1}
I20260812 11:11:11.450691 16908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36596:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:11:11.451001 16908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36596:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:11:11.454303 16908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c: Sending DeleteTablet for 3 replicas of tablet 9c85bd8bd5154930ae5c9e391b8a4e3c
I20260812 11:11:11.455210 17644 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c85bd8bd5154930ae5c9e391b8a4e3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:11 UTC) from {username='oryx', principal='oryx/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:46630
I20260812 11:11:11.455233 17394 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c85bd8bd5154930ae5c9e391b8a4e3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:11 UTC) from {username='oryx', principal='oryx/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:39044
I20260812 11:11:11.455895 17949 tablet_replica.cc:330] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00: stopping tablet replica
I20260812 11:11:11.455919 17134 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c85bd8bd5154930ae5c9e391b8a4e3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:11 UTC) from {username='oryx', principal='oryx/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:52574
I20260812 11:11:11.456086 17949 raft_consensus.cc:2229] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:11:11.456367 17949 raft_consensus.cc:2258] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:11.456775 17952 tablet_replica.cc:330] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9: stopping tablet replica
I20260812 11:11:11.457056 17952 raft_consensus.cc:2229] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:11:11.457508 17952 raft_consensus.cc:2258] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:11.457597 17949 ts_tablet_manager.cc:1905] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:11.458818 17952 ts_tablet_manager.cc:1905] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:11.466387 17952 ts_tablet_manager.cc:1918] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:11:11.466713 17952 log.cc:1196] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/9c85bd8bd5154930ae5c9e391b8a4e3c
I20260812 11:11:11.467338 17952 ts_tablet_manager.cc:1939] T 9c85bd8bd5154930ae5c9e391b8a4e3c P c0affbbc08c5422e8aba5300ecd6fea9: Deleting consensus metadata
I20260812 11:11:11.468899 16881 catalog_manager.cc:4841] TS c0affbbc08c5422e8aba5300ecd6fea9 (127.4.26.65:45829): tablet 9c85bd8bd5154930ae5c9e391b8a4e3c (table test-table [id=97b2ee3f947e463d99460f141ced86e7]) successfully deleted
I20260812 11:11:11.469470 17949 ts_tablet_manager.cc:1918] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:11:11.469620 17949 log.cc:1196] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/9c85bd8bd5154930ae5c9e391b8a4e3c
I20260812 11:11:11.470005 17949 ts_tablet_manager.cc:1939] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Deleting consensus metadata
I20260812 11:11:11.470995 16882 catalog_manager.cc:4841] TS 0a8dcad2bfd4426ebdb7ab5ed7402e00 (127.4.26.67:40457): tablet 9c85bd8bd5154930ae5c9e391b8a4e3c (table test-table [id=97b2ee3f947e463d99460f141ced86e7]) successfully deleted
I20260812 11:11:11.478255 17951 tablet_replica.cc:330] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903: stopping tablet replica
I20260812 11:11:11.478673 17951 raft_consensus.cc:2229] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:11:11.479264 17951 raft_consensus.cc:2258] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:11.480768 17951 ts_tablet_manager.cc:1905] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:11.485854 17951 ts_tablet_manager.cc:1918] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:11:11.485999 17951 log.cc:1196] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/9c85bd8bd5154930ae5c9e391b8a4e3c
I20260812 11:11:11.486397 17951 ts_tablet_manager.cc:1939] T 9c85bd8bd5154930ae5c9e391b8a4e3c P 3162c6992e8d4637afd98a19c33fc903: Deleting consensus metadata
I20260812 11:11:11.487422 16881 catalog_manager.cc:4841] TS 3162c6992e8d4637afd98a19c33fc903 (127.4.26.66:37975): tablet 9c85bd8bd5154930ae5c9e391b8a4e3c (table test-table [id=97b2ee3f947e463d99460f141ced86e7]) successfully deleted
Aug 12 11:11:11 dist-test-slave-rmhg krb5kdc[16833](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533071, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 12 11:11:11 dist-test-slave-rmhg krb5kdc[16833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:11 dist-test-slave-rmhg krb5kdc[16833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:11:11.533839 17888 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:11.523207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36616 (local address 127.4.26.126:41881)
0812 11:11:11.523447 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:11.523453 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:11.523802 (+ 349us) server_negotiation.cc:407] Connection header received
0812 11:11:11.523960 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:11.523966 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:11.524056 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:11.524183 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:11.525636 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.526805 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.528083 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.528713 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.528831 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:11.533544 (+ 4713us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36616: BlockingRecv error: recv got EOF from 127.0.0.1:36616 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 11:11:11 dist-test-slave-rmhg krb5kdc[16833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533071, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM
I20260812 11:11:11.553761 17888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:11.536485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36628 (local address 127.4.26.126:41881)
0812 11:11:11.536673 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:11.536678 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:11.536989 (+ 311us) server_negotiation.cc:407] Connection header received
0812 11:11:11.537219 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:11.537225 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:11.537297 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:11.537382 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:11.538882 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.539606 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.541404 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.541843 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.541937 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:11.547108 (+ 5171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:11.547114 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:11.547117 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:11.547163 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:11.550501 (+ 3338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:11.551430 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:11.551435 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:11.551437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:11.551655 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:11.552091 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:11.552097 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:11.552100 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:11.552498 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:11.552794 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:11.553075 (+ 281us) server_negotiation.cc:299] Negotiation successful
0812 11:11:11.553388 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 11:11:11.557524 16908 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36628:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:11:11.558187 16908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:11:11.565577 17134 tablet_service.cc:1467] Processing CreateTablet for tablet 8a5eabf25bc740ca92bb93f2ab67afcf (DEFAULT_TABLE table=test-table [id=6d33e9d9466741988c924cd5f64e32d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:11.565800 17644 tablet_service.cc:1467] Processing CreateTablet for tablet 8a5eabf25bc740ca92bb93f2ab67afcf (DEFAULT_TABLE table=test-table [id=6d33e9d9466741988c924cd5f64e32d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:11.566118 17134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a5eabf25bc740ca92bb93f2ab67afcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:11.566241 17644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a5eabf25bc740ca92bb93f2ab67afcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:11.571420 17969 tablet_bootstrap.cc:492] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Bootstrap starting.
I20260812 11:11:11.573001 17969 tablet_bootstrap.cc:654] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:11.574673 17394 tablet_service.cc:1467] Processing CreateTablet for tablet 8a5eabf25bc740ca92bb93f2ab67afcf (DEFAULT_TABLE table=test-table [id=6d33e9d9466741988c924cd5f64e32d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:11.575280 17394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a5eabf25bc740ca92bb93f2ab67afcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:11.586022 17970 tablet_bootstrap.cc:492] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9: Bootstrap starting.
I20260812 11:11:11.586922 17973 tablet_bootstrap.cc:492] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903: Bootstrap starting.
I20260812 11:11:11.590596 17973 tablet_bootstrap.cc:654] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:11.590591 17970 tablet_bootstrap.cc:654] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:11.593449 17969 tablet_bootstrap.cc:492] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00: No bootstrap required, opened a new log
I20260812 11:11:11.593761 17969 ts_tablet_manager.cc:1397] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.019s
I20260812 11:11:11.594738 17969 raft_consensus.cc:348] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.595206 17969 raft_consensus.cc:374] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:11.595350 17969 raft_consensus.cc:729] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a8dcad2bfd4426ebdb7ab5ed7402e00, State: Initialized, Role: FOLLOWER
I20260812 11:11:11.595700 17969 consensus_queue.cc:260] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.596478 17969 ts_tablet_manager.cc:1428] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260812 11:11:11.598042 17973 tablet_bootstrap.cc:492] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903: No bootstrap required, opened a new log
I20260812 11:11:11.598208 17973 ts_tablet_manager.cc:1397] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260812 11:11:11.598868 17973 raft_consensus.cc:348] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.599125 17973 raft_consensus.cc:374] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:11.599231 17973 raft_consensus.cc:729] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3162c6992e8d4637afd98a19c33fc903, State: Initialized, Role: FOLLOWER
I20260812 11:11:11.599522 17973 consensus_queue.cc:260] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.600241 17973 ts_tablet_manager.cc:1428] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 11:11:11.606706 17970 tablet_bootstrap.cc:492] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9: No bootstrap required, opened a new log
I20260812 11:11:11.606901 17970 ts_tablet_manager.cc:1397] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.009s
I20260812 11:11:11.607738 17970 raft_consensus.cc:348] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.607991 17970 raft_consensus.cc:374] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:11.608173 17970 raft_consensus.cc:729] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0affbbc08c5422e8aba5300ecd6fea9, State: Initialized, Role: FOLLOWER
I20260812 11:11:11.608472 17970 consensus_queue.cc:260] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.609126 17970 ts_tablet_manager.cc:1428] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260812 11:11:11.839509 17904 raft_consensus.cc:482] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:11:11.839758 17904 raft_consensus.cc:504] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.840544 17904 leader_election.cc:288] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0affbbc08c5422e8aba5300ecd6fea9 (127.4.26.65:45829), 3162c6992e8d4637afd98a19c33fc903 (127.4.26.66:37975)
I20260812 11:11:11.841353 17431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a5eabf25bc740ca92bb93f2ab67afcf" candidate_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3162c6992e8d4637afd98a19c33fc903" is_pre_election: true
I20260812 11:11:11.841364 17172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a5eabf25bc740ca92bb93f2ab67afcf" candidate_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" is_pre_election: true
I20260812 11:11:11.841617 17431 raft_consensus.cc:2454] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a8dcad2bfd4426ebdb7ab5ed7402e00 in term 0.
I20260812 11:11:11.841620 17172 raft_consensus.cc:2454] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a8dcad2bfd4426ebdb7ab5ed7402e00 in term 0.
I20260812 11:11:11.842135 17563 leader_election.cc:302] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a8dcad2bfd4426ebdb7ab5ed7402e00, c0affbbc08c5422e8aba5300ecd6fea9; no voters:
I20260812 11:11:11.842435 17904 raft_consensus.cc:2781] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:11:11.842586 17904 raft_consensus.cc:482] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:11:11.842700 17904 raft_consensus.cc:3037] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:11.844849 17904 raft_consensus.cc:504] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.845500 17904 leader_election.cc:288] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [CANDIDATE]: Term 1 election: Requested vote from peers c0affbbc08c5422e8aba5300ecd6fea9 (127.4.26.65:45829), 3162c6992e8d4637afd98a19c33fc903 (127.4.26.66:37975)
I20260812 11:11:11.846043 17172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a5eabf25bc740ca92bb93f2ab67afcf" candidate_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0affbbc08c5422e8aba5300ecd6fea9"
I20260812 11:11:11.846081 17431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a5eabf25bc740ca92bb93f2ab67afcf" candidate_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3162c6992e8d4637afd98a19c33fc903"
I20260812 11:11:11.846264 17431 raft_consensus.cc:3037] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:11.846273 17172 raft_consensus.cc:3037] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:11.848452 17172 raft_consensus.cc:2454] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a8dcad2bfd4426ebdb7ab5ed7402e00 in term 1.
I20260812 11:11:11.848454 17431 raft_consensus.cc:2454] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a8dcad2bfd4426ebdb7ab5ed7402e00 in term 1.
I20260812 11:11:11.848970 17563 leader_election.cc:302] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a8dcad2bfd4426ebdb7ab5ed7402e00, c0affbbc08c5422e8aba5300ecd6fea9; no voters:
I20260812 11:11:11.849324 17904 raft_consensus.cc:2781] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:11:11.849836 17904 raft_consensus.cc:686] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 LEADER]: Becoming Leader. State: Replica: 0a8dcad2bfd4426ebdb7ab5ed7402e00, State: Running, Role: LEADER
I20260812 11:11:11.850353 17904 consensus_queue.cc:237] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.854061 16908 catalog_manager.cc:5495] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a8dcad2bfd4426ebdb7ab5ed7402e00 (127.4.26.67). New cstate: current_term: 1 leader_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } health_report { overall_health: HEALTHY } } }
I20260812 11:11:11.891317 17983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:11.884962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46644 (local address 127.4.26.67:40457)
0812 11:11:11.885553 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:11.885558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:11.885576 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:11:11.885677 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:11.885680 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:11.885760 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:11.885920 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:11:11.886337 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.887156 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.888807 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:11.889399 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:11.889517 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:11.890000 (+ 483us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:11:11.890662 (+ 662us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:11:11.890811 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:11.890909 (+ 98us) server_negotiation.cc:299] Negotiation successful
0812 11:11:11.890998 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":299,"threads_started":1}
I20260812 11:11:11.894996 17431 raft_consensus.cc:1261] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Refusing update from remote peer 0a8dcad2bfd4426ebdb7ab5ed7402e00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:11:11.894996 17172 raft_consensus.cc:1261] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Refusing update from remote peer 0a8dcad2bfd4426ebdb7ab5ed7402e00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:11:11.895670 17904 consensus_queue.cc:1035] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:11:11.896052 17978 consensus_queue.cc:1035] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:11:11.919829 16909 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:11:11.920171 16909 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:11:11.923388 16909 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c: Sending DeleteTablet for 3 replicas of tablet 8a5eabf25bc740ca92bb93f2ab67afcf
I20260812 11:11:11.924407 17134 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a5eabf25bc740ca92bb93f2ab67afcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:11 UTC) from {username='oryx', principal='oryx/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:52574
I20260812 11:11:11.924481 17644 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a5eabf25bc740ca92bb93f2ab67afcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:11 UTC) from {username='oryx', principal='oryx/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:46630
I20260812 11:11:11.924736 17952 tablet_replica.cc:330] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9: stopping tablet replica
I20260812 11:11:11.924800 17949 tablet_replica.cc:330] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00: stopping tablet replica
I20260812 11:11:11.924939 17952 raft_consensus.cc:2229] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:11:11.925005 17949 raft_consensus.cc:2229] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:11:11.925287 17952 raft_consensus.cc:2258] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:11.925575 17949 raft_consensus.cc:2258] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:11.925623 16909 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36628:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:11:11.926345 16909 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:11:11.926728 17952 ts_tablet_manager.cc:1905] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:11.926904 17949 ts_tablet_manager.cc:1905] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:11.928845 17394 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a5eabf25bc740ca92bb93f2ab67afcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:11 UTC) from {username='oryx', principal='oryx/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:39044
I20260812 11:11:11.929186 17951 tablet_replica.cc:330] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903: stopping tablet replica
I20260812 11:11:11.929383 17951 raft_consensus.cc:2229] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:11:11.929621 17951 raft_consensus.cc:2258] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:11.931104 17951 ts_tablet_manager.cc:1905] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:11.935384 17949 ts_tablet_manager.cc:1918] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:11:11.935509 17134 tablet_service.cc:1467] Processing CreateTablet for tablet 362bba56e0954431b09f8f6c7baafe23 (DEFAULT_TABLE table=test-table [id=8af1b01a63f342f18717594ebc2bb783]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:11.935521 17644 tablet_service.cc:1467] Processing CreateTablet for tablet 362bba56e0954431b09f8f6c7baafe23 (DEFAULT_TABLE table=test-table [id=8af1b01a63f342f18717594ebc2bb783]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:11.935870 17949 log.cc:1196] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/8a5eabf25bc740ca92bb93f2ab67afcf
I20260812 11:11:11.935973 17134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 362bba56e0954431b09f8f6c7baafe23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:11.936012 17644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 362bba56e0954431b09f8f6c7baafe23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:11.936499 17949 ts_tablet_manager.cc:1939] T 8a5eabf25bc740ca92bb93f2ab67afcf P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Deleting consensus metadata
I20260812 11:11:11.941536 16882 catalog_manager.cc:4841] TS 0a8dcad2bfd4426ebdb7ab5ed7402e00 (127.4.26.67:40457): tablet 8a5eabf25bc740ca92bb93f2ab67afcf (table test-table [id=6d33e9d9466741988c924cd5f64e32d9]) successfully deleted
I20260812 11:11:11.942490 17394 tablet_service.cc:1467] Processing CreateTablet for tablet 362bba56e0954431b09f8f6c7baafe23 (DEFAULT_TABLE table=test-table [id=8af1b01a63f342f18717594ebc2bb783]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:11.942607 17970 tablet_bootstrap.cc:492] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9: Bootstrap starting.
I20260812 11:11:11.942982 17394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 362bba56e0954431b09f8f6c7baafe23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:11.944258 17970 tablet_bootstrap.cc:654] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:11.946777 17952 ts_tablet_manager.cc:1918] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:11:11.947045 17952 log.cc:1196] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/8a5eabf25bc740ca92bb93f2ab67afcf
I20260812 11:11:11.947625 17952 ts_tablet_manager.cc:1939] T 8a5eabf25bc740ca92bb93f2ab67afcf P c0affbbc08c5422e8aba5300ecd6fea9: Deleting consensus metadata
I20260812 11:11:11.949074 16881 catalog_manager.cc:4841] TS c0affbbc08c5422e8aba5300ecd6fea9 (127.4.26.65:45829): tablet 8a5eabf25bc740ca92bb93f2ab67afcf (table test-table [id=6d33e9d9466741988c924cd5f64e32d9]) successfully deleted
I20260812 11:11:11.950881 17970 tablet_bootstrap.cc:492] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9: No bootstrap required, opened a new log
I20260812 11:11:11.951145 17970 ts_tablet_manager.cc:1397] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260812 11:11:11.951930 17970 raft_consensus.cc:348] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.952203 17973 tablet_bootstrap.cc:492] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903: Bootstrap starting.
I20260812 11:11:11.952332 17970 raft_consensus.cc:374] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:11.952479 17970 raft_consensus.cc:729] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0affbbc08c5422e8aba5300ecd6fea9, State: Initialized, Role: FOLLOWER
I20260812 11:11:11.952827 17970 consensus_queue.cc:260] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.953610 17970 ts_tablet_manager.cc:1428] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260812 11:11:11.954046 17973 tablet_bootstrap.cc:654] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:11.954721 17951 ts_tablet_manager.cc:1918] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:11:11.954896 17951 log.cc:1196] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/8a5eabf25bc740ca92bb93f2ab67afcf
I20260812 11:11:11.955369 17951 ts_tablet_manager.cc:1939] T 8a5eabf25bc740ca92bb93f2ab67afcf P 3162c6992e8d4637afd98a19c33fc903: Deleting consensus metadata
I20260812 11:11:11.956533 16881 catalog_manager.cc:4841] TS 3162c6992e8d4637afd98a19c33fc903 (127.4.26.66:37975): tablet 8a5eabf25bc740ca92bb93f2ab67afcf (table test-table [id=6d33e9d9466741988c924cd5f64e32d9]) successfully deleted
I20260812 11:11:11.956981 17969 tablet_bootstrap.cc:492] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Bootstrap starting.
I20260812 11:11:11.958889 17969 tablet_bootstrap.cc:654] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:11.963922 17969 tablet_bootstrap.cc:492] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: No bootstrap required, opened a new log
I20260812 11:11:11.964172 17969 ts_tablet_manager.cc:1397] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260812 11:11:11.965143 17969 raft_consensus.cc:348] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.965449 17969 raft_consensus.cc:374] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:11.965533 17969 raft_consensus.cc:729] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a8dcad2bfd4426ebdb7ab5ed7402e00, State: Initialized, Role: FOLLOWER
I20260812 11:11:11.965790 17969 consensus_queue.cc:260] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.966348 17969 ts_tablet_manager.cc:1428] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 11:11:11.966476 17973 tablet_bootstrap.cc:492] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903: No bootstrap required, opened a new log
I20260812 11:11:11.966670 17973 ts_tablet_manager.cc:1397] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.008s
I20260812 11:11:11.967388 17973 raft_consensus.cc:348] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.967579 17973 raft_consensus.cc:374] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:11.967657 17973 raft_consensus.cc:729] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3162c6992e8d4637afd98a19c33fc903, State: Initialized, Role: FOLLOWER
I20260812 11:11:11.967893 17973 consensus_queue.cc:260] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:11.968420 17973 ts_tablet_manager.cc:1428] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260812 11:11:12.000248 17904 raft_consensus.cc:482] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:11:12.000509 17904 raft_consensus.cc:504] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:12.001245 17904 leader_election.cc:288] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0affbbc08c5422e8aba5300ecd6fea9 (127.4.26.65:45829), 3162c6992e8d4637afd98a19c33fc903 (127.4.26.66:37975)
I20260812 11:11:12.001830 17172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362bba56e0954431b09f8f6c7baafe23" candidate_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" is_pre_election: true
I20260812 11:11:12.001933 17431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362bba56e0954431b09f8f6c7baafe23" candidate_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3162c6992e8d4637afd98a19c33fc903" is_pre_election: true
I20260812 11:11:12.002080 17172 raft_consensus.cc:2454] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a8dcad2bfd4426ebdb7ab5ed7402e00 in term 0.
I20260812 11:11:12.002235 17431 raft_consensus.cc:2454] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a8dcad2bfd4426ebdb7ab5ed7402e00 in term 0.
I20260812 11:11:12.002640 17563 leader_election.cc:302] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a8dcad2bfd4426ebdb7ab5ed7402e00, c0affbbc08c5422e8aba5300ecd6fea9; no voters:
I20260812 11:11:12.002945 17904 raft_consensus.cc:2781] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:11:12.003086 17904 raft_consensus.cc:482] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:11:12.003187 17904 raft_consensus.cc:3037] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:12.005663 17904 raft_consensus.cc:504] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:12.006386 17904 leader_election.cc:288] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [CANDIDATE]: Term 1 election: Requested vote from peers c0affbbc08c5422e8aba5300ecd6fea9 (127.4.26.65:45829), 3162c6992e8d4637afd98a19c33fc903 (127.4.26.66:37975)
I20260812 11:11:12.007001 17172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362bba56e0954431b09f8f6c7baafe23" candidate_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0affbbc08c5422e8aba5300ecd6fea9"
I20260812 11:11:12.007239 17172 raft_consensus.cc:3037] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:12.007159 17431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "362bba56e0954431b09f8f6c7baafe23" candidate_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3162c6992e8d4637afd98a19c33fc903"
I20260812 11:11:12.007398 17431 raft_consensus.cc:3037] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:12.009523 17172 raft_consensus.cc:2454] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a8dcad2bfd4426ebdb7ab5ed7402e00 in term 1.
I20260812 11:11:12.010114 17563 leader_election.cc:302] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a8dcad2bfd4426ebdb7ab5ed7402e00, c0affbbc08c5422e8aba5300ecd6fea9; no voters:
I20260812 11:11:12.010464 17904 raft_consensus.cc:2781] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:11:12.010725 17904 raft_consensus.cc:686] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 LEADER]: Becoming Leader. State: Replica: 0a8dcad2bfd4426ebdb7ab5ed7402e00, State: Running, Role: LEADER
I20260812 11:11:12.010607 17431 raft_consensus.cc:2454] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a8dcad2bfd4426ebdb7ab5ed7402e00 in term 1.
I20260812 11:11:12.011039 17904 consensus_queue.cc:237] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } }
I20260812 11:11:12.014185 16903 catalog_manager.cc:5495] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a8dcad2bfd4426ebdb7ab5ed7402e00 (127.4.26.67). New cstate: current_term: 1 leader_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a8dcad2bfd4426ebdb7ab5ed7402e00" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40457 } health_report { overall_health: HEALTHY } } }
I20260812 11:11:12.055610 18005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:12.048053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45829 (local address 127.4.26.67:57297)
0812 11:11:12.049012 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:12.049053 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:12.049276 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:12.049618 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:12.049623 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:12.049637 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:11:12.050115 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:12.050129 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:12.051370 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:12.051377 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:12.053252 (+ 1875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:12.053269 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:12.054367 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:12.054372 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:12.054505 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:12.054579 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:11:12.055031 (+ 452us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:11:12.055044 (+ 13us) client_negotiation.cc:769] Sending connection context
0812 11:11:12.055137 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 11:11:12.055290 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":733,"thread_start_us":555,"threads_started":1}
I20260812 11:11:12.055635 18003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:12.048088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:57297 (local address 127.4.26.65:45829)
0812 11:11:12.048689 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:12.048696 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:12.049132 (+ 436us) server_negotiation.cc:407] Connection header received
0812 11:11:12.049409 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:12.049413 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:12.049483 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:12.049567 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:11:12.050394 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:12.051227 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:12.053449 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:12.054161 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:12.054290 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:12.054766 (+ 476us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:11:12.054919 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:11:12.055026 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:12.055190 (+ 164us) server_negotiation.cc:299] Negotiation successful
0812 11:11:12.055286 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":263,"threads_started":1}
I20260812 11:11:12.064611 17431 raft_consensus.cc:1261] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Refusing update from remote peer 0a8dcad2bfd4426ebdb7ab5ed7402e00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:11:12.064610 17172 raft_consensus.cc:1261] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Refusing update from remote peer 0a8dcad2bfd4426ebdb7ab5ed7402e00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:11:12.065336 17978 consensus_queue.cc:1035] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0affbbc08c5422e8aba5300ecd6fea9" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:11:12.065740 17904 consensus_queue.cc:1035] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3162c6992e8d4637afd98a19c33fc903" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:11:12.099587 17983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:12.090738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:58457 (local address 127.4.26.67:40457)
0812 11:11:12.090922 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:12.090928 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:12.093548 (+ 2620us) server_negotiation.cc:407] Connection header received
0812 11:11:12.093853 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:12.093864 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:12.093956 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:12.094026 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:11:12.094648 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:12.095432 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:12.097315 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:12.097954 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:12.098069 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:12.098694 (+ 625us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:11:12.098896 (+ 202us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:11:12.098965 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:12.099192 (+ 227us) server_negotiation.cc:299] Negotiation successful
0812 11:11:12.099285 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260812 11:11:12.100543 18013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:12.090311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:40457 (local address 127.4.26.65:58457)
0812 11:11:12.093439 (+ 3128us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:12.093468 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:12.093682 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:12.094232 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:12.094238 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:12.094250 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0812 11:11:12.094498 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:12.094507 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:12.095575 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:12.095581 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:12.097114 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:12.097127 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:12.098250 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:12.098256 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:12.098431 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:12.098495 (+ 64us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0812 11:11:12.099053 (+ 558us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0812 11:11:12.099063 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 11:11:12.099979 (+ 916us) client_negotiation.cc:240] Negotiation successful
0812 11:11:12.100141 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2962,"thread_start_us":2773,"threads_started":1}
I20260812 11:11:12.132333 16908 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:11:12.132601 16908 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:11:12.135918 16908 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f99d7399c6e64771bcac7781edc63d9c: Sending DeleteTablet for 3 replicas of tablet 362bba56e0954431b09f8f6c7baafe23
I20260812 11:11:12.136979 17394 tablet_service.cc:1514] Processing DeleteTablet for tablet 362bba56e0954431b09f8f6c7baafe23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:12 UTC) from {username='oryx', principal='oryx/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:39044
I20260812 11:11:12.136967 17644 tablet_service.cc:1514] Processing DeleteTablet for tablet 362bba56e0954431b09f8f6c7baafe23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:12 UTC) from {username='oryx', principal='oryx/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:46630
I20260812 11:11:12.137220 17134 tablet_service.cc:1514] Processing DeleteTablet for tablet 362bba56e0954431b09f8f6c7baafe23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:12 UTC) from {username='oryx', principal='oryx/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:52574
I20260812 11:11:12.137308 17951 tablet_replica.cc:330] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903: stopping tablet replica
I20260812 11:11:12.137477 17951 raft_consensus.cc:2229] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:11:12.137566 17952 tablet_replica.cc:330] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9: stopping tablet replica
I20260812 11:11:12.137704 17951 raft_consensus.cc:2258] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:12.137741 17952 raft_consensus.cc:2229] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:11:12.137941 17952 raft_consensus.cc:2258] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:12.138253 17949 tablet_replica.cc:330] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: stopping tablet replica
I20260812 11:11:12.138453 17949 raft_consensus.cc:2229] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:11:12.138535 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 17024
I20260812 11:11:12.138787 17949 raft_consensus.cc:2258] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:12.139904 17949 ts_tablet_manager.cc:1905] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:12.140182 17952 ts_tablet_manager.cc:1905] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:12.146929 17952 ts_tablet_manager.cc:1918] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:11:12.146931 17949 ts_tablet_manager.cc:1918] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:11:12.147100 17952 log.cc:1196] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/362bba56e0954431b09f8f6c7baafe23
I20260812 11:11:12.147598 17952 ts_tablet_manager.cc:1939] T 362bba56e0954431b09f8f6c7baafe23 P c0affbbc08c5422e8aba5300ecd6fea9: Deleting consensus metadata
I20260812 11:11:12.148065 17951 ts_tablet_manager.cc:1905] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:12.148851 16881 catalog_manager.cc:4841] TS c0affbbc08c5422e8aba5300ecd6fea9 (127.4.26.65:45829): tablet 362bba56e0954431b09f8f6c7baafe23 (table test-table [id=8af1b01a63f342f18717594ebc2bb783]) successfully deleted
Aug 12 11:11:12 dist-test-slave-rmhg krb5kdc[16833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533071, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.26.65@KRBTEST.COM
I20260812 11:11:12.153504 17949 log.cc:1196] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/362bba56e0954431b09f8f6c7baafe23
I20260812 11:11:12.154153 17949 ts_tablet_manager.cc:1939] T 362bba56e0954431b09f8f6c7baafe23 P 0a8dcad2bfd4426ebdb7ab5ed7402e00: Deleting consensus metadata
I20260812 11:11:12.154637 17951 ts_tablet_manager.cc:1918] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260812 11:11:12.154799 17951 log.cc:1196] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/362bba56e0954431b09f8f6c7baafe23
I20260812 11:11:12.155208 17951 ts_tablet_manager.cc:1939] T 362bba56e0954431b09f8f6c7baafe23 P 3162c6992e8d4637afd98a19c33fc903: Deleting consensus metadata
I20260812 11:11:12.156261 16882 catalog_manager.cc:4841] TS 0a8dcad2bfd4426ebdb7ab5ed7402e00 (127.4.26.67:40457): tablet 362bba56e0954431b09f8f6c7baafe23 (table test-table [id=8af1b01a63f342f18717594ebc2bb783]) successfully deleted
I20260812 11:11:12.156315 16881 catalog_manager.cc:4841] TS 3162c6992e8d4637afd98a19c33fc903 (127.4.26.66:37975): tablet 362bba56e0954431b09f8f6c7baafe23 (table test-table [id=8af1b01a63f342f18717594ebc2bb783]) successfully deleted
I20260812 11:11:12.160753 18003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:12.139767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52594 (local address 127.4.26.65:45829)
0812 11:11:12.139956 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:12.139963 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:12.141951 (+ 1988us) server_negotiation.cc:407] Connection header received
0812 11:11:12.142118 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:12.142124 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:12.142216 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:12.142314 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:12.144136 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:12.145457 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:12.147410 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:12.148148 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:12.148254 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:12.154028 (+ 5774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:12.154052 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:12.154076 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:12.154127 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:12.157779 (+ 3652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:12.158546 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:12.158556 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:12.158558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:12.158705 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:12.159098 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:12.159102 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:12.159105 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:12.159488 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:12.159808 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:12.160187 (+ 379us) server_negotiation.cc:299] Negotiation successful
0812 11:11:12.160425 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 11:11:12.161685 17263 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:12.318555 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 17024
I20260812 11:11:12.348140 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 17282
Aug 12 11:11:12 dist-test-slave-rmhg krb5kdc[16833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533071, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.26.66@KRBTEST.COM
I20260812 11:11:12.368266 18019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:12.349048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39060 (local address 127.4.26.66:37975)
0812 11:11:12.349769 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:12.349777 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:12.349821 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:11:12.349892 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:12.349897 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:12.349991 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:12.350130 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:12.351628 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:12.352797 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:12.354284 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:12.354972 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:12.355129 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:12.359875 (+ 4746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:12.359896 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:12.359921 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:12.359987 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:12.364544 (+ 4557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:12.365575 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:12.365587 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:12.365592 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:12.365801 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:12.366332 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:12.366338 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:12.366341 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:12.366902 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:12.367260 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:12.367586 (+ 326us) server_negotiation.cc:299] Negotiation successful
0812 11:11:12.367863 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":522,"threads_started":1}
I20260812 11:11:12.369109 17522 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:12.500041 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 17282
I20260812 11:11:12.526333 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 17536
Aug 12 11:11:12 dist-test-slave-rmhg krb5kdc[16833](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533071, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.26.67@KRBTEST.COM
I20260812 11:11:12.542047 17983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:12.527090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46656 (local address 127.4.26.67:40457)
0812 11:11:12.527261 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:12.527265 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:12.527331 (+ 66us) server_negotiation.cc:407] Connection header received
0812 11:11:12.527520 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:12.527524 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:12.527592 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:12.527739 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:12.528981 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:12.529823 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:12.531067 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:12.531478 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:12.531577 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:12.536141 (+ 4564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:12.536159 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:12.536180 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:12.536227 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:12.539206 (+ 2979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:12.540031 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:12.540040 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:12.540042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:12.540207 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:12.540580 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:12.540583 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:12.540585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:12.540992 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:12.541447 (+ 455us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:12.541586 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 11:11:12.541785 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:11:12.542725 17748 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:12.670517 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 17536
I20260812 11:11:12.696501 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 16850
I20260812 11:11:12.697782 16972 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:12.815486 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 16850
2026-08-12T11:11:12Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6913 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:11:12 dist-test-slave-rmhg krb5kdc[18028](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:11:12 dist-test-slave-rmhg krb5kdc[18028](info): set up 2 sockets
Aug 12 11:11:12 dist-test-slave-rmhg krb5kdc[18028](info): commencing operation
krb5kdc: starting...
W20260812 11:11:14.070454 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.001s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:11:14 dist-test-slave-rmhg krb5kdc[18028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533074, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:11:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:11:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:11:14.332558 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37421
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:37421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:11:14.675586 18054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:14.675925 18054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:14.676062 18054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:14.683512 18054 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:11:14.683655 18054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:14.683729 18054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:14.683820 18054 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:11:14.683879 18054 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:11:14.694232 18054 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:37421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:14.695686 18054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:14.697118 18054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:14.709764 18066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:14.709774 18067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:14.709815 18072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:14.710698 18054 server_base.cc:1034] running on GCE node
I20260812 11:11:14.711539 18054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:14.713083 18054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:14.714324 18054 hybrid_clock.cc:648] HybridClock initialized: now 1786533074714268 us; error 52 us; skew 500 ppm
I20260812 11:11:14.714704 18054 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-12T11:11:14Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1961 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:11:14 dist-test-slave-rmhg krb5kdc[18080](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:11:14 dist-test-slave-rmhg krb5kdc[18080](info): set up 2 sockets
Aug 12 11:11:14 dist-test-slave-rmhg krb5kdc[18080](info): commencing operation
krb5kdc: starting...
W20260812 11:11:16.040307 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.211s user 0.004s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:11:16 dist-test-slave-rmhg krb5kdc[18080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:11:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:11:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:11:16.306409 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:40269
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:40269
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:11:16.652392 18103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:16.652721 18103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:16.652843 18103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:16.660451 18103 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:11:16.660593 18103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:16.660650 18103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:16.660733 18103 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:11:16.660787 18103 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:11:16.671181 18103 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:40269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:40269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:16.672652 18103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:16.674057 18103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:16.686489 18110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:16.686474 18111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:16.686826 18113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:16.687305 18103 server_base.cc:1034] running on GCE node
I20260812 11:11:16.688128 18103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:16.689687 18103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:16.690919 18103 hybrid_clock.cc:648] HybridClock initialized: now 1786533076690860 us; error 44 us; skew 500 ppm
I20260812 11:11:16.691289 18103 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:16 dist-test-slave-rmhg krb5kdc[18080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533076, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:16.699347 18103 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:11:16.701279 18103 webserver.cc:460] Webserver started at http://127.4.26.126:33389/ using document root <none> and password file <none>
I20260812 11:11:16.702066 18103 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:16.702222 18103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:16.702555 18103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:16.705883 18103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "0fde40194484436190d466f0d75ee8b2"
format_stamp: "Formatted at 2026-08-12 11:11:16 on dist-test-slave-rmhg"
server_key: "17e0c05235e979bce12eb900d3d016ba"
server_key_iv: "d45081119abf0b406316d79c6e2944f9"
server_key_version: "encryptionkey@0"
I20260812 11:11:16.706743 18103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "0fde40194484436190d466f0d75ee8b2"
format_stamp: "Formatted at 2026-08-12 11:11:16 on dist-test-slave-rmhg"
server_key: "17e0c05235e979bce12eb900d3d016ba"
server_key_iv: "d45081119abf0b406316d79c6e2944f9"
server_key_version: "encryptionkey@0"
I20260812 11:11:16.712697 18103 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 11:11:16.716849 18125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:16.718410 18103 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:11:16.718614 18103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "0fde40194484436190d466f0d75ee8b2"
format_stamp: "Formatted at 2026-08-12 11:11:16 on dist-test-slave-rmhg"
server_key: "17e0c05235e979bce12eb900d3d016ba"
server_key_iv: "d45081119abf0b406316d79c6e2944f9"
server_key_version: "encryptionkey@0"
I20260812 11:11:16.718839 18103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:16.762897 18103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:16.767694 18103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:16.768020 18103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:16.787220 18103 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:40269
I20260812 11:11:16.787240 18205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:40269 every 8 connection(s)
I20260812 11:11:16.788749 18103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:11:16.792825 18209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:16.793718 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 18103
I20260812 11:11:16.793946 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:11:16.794776 4201 external_mini_cluster.cc:1428] Setting key 3dcaea781fc35396cb04932af9fa3c90
I20260812 11:11:16.806929 18209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2: Bootstrap starting.
Aug 12 11:11:16 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:11:16.810920 18209 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:16.812076 18209 log.cc:824] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2: Log is configured to *not* fsync() on all Append() calls
I20260812 11:11:16.815587 18209 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2: No bootstrap required, opened a new log
I20260812 11:11:16.818791 18213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:16.797177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34454 (local address 127.4.26.126:40269)
0812 11:11:16.798075 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:16.798089 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:16.798155 (+ 66us) server_negotiation.cc:407] Connection header received
0812 11:11:16.799882 (+ 1727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:16.799914 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:16.800390 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:16.800815 (+ 425us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:16.802494 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:16.803863 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:16.805281 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:16.806007 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:16.806202 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:16.810844 (+ 4642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:16.810853 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:16.810870 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:16.810921 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:16.814383 (+ 3462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:16.815261 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:16.815269 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:16.815276 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:16.815440 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:16.815861 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:16.815865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:16.815867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:16.816436 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:16.816664 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:16.817130 (+ 466us) server_negotiation.cc:299] Negotiation successful
0812 11:11:16.817569 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":379,"threads_started":1}
I20260812 11:11:16.823935 18209 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fde40194484436190d466f0d75ee8b2" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40269 } }
I20260812 11:11:16.824316 18209 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:16.824419 18209 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fde40194484436190d466f0d75ee8b2, State: Initialized, Role: FOLLOWER
I20260812 11:11:16.824999 18209 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fde40194484436190d466f0d75ee8b2" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40269 } }
I20260812 11:11:16.825274 18209 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:11:16.825412 18209 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:11:16.825565 18209 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:16.827782 18209 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fde40194484436190d466f0d75ee8b2" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40269 } }
I20260812 11:11:16.828317 18209 leader_election.cc:302] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fde40194484436190d466f0d75ee8b2; no voters:
I20260812 11:11:16.828883 18209 leader_election.cc:288] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:11:16.828999 18215 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:11:16.829695 18215 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 1 LEADER]: Becoming Leader. State: Replica: 0fde40194484436190d466f0d75ee8b2, State: Running, Role: LEADER
I20260812 11:11:16.830269 18215 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fde40194484436190d466f0d75ee8b2" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40269 } }
I20260812 11:11:16.830962 18209 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:11:16.832823 18217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fde40194484436190d466f0d75ee8b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fde40194484436190d466f0d75ee8b2" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40269 } } }
I20260812 11:11:16.833264 18217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [sys.catalog]: This master's current role is: LEADER
I20260812 11:11:16.835397 18218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fde40194484436190d466f0d75ee8b2. Latest consensus state: current_term: 1 leader_uuid: "0fde40194484436190d466f0d75ee8b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fde40194484436190d466f0d75ee8b2" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40269 } } }
I20260812 11:11:16.835647 18218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [sys.catalog]: This master's current role is: LEADER
I20260812 11:11:16.838297 18222 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:11:16.844291 18222 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:11:16.854604 18222 catalog_manager.cc:1347] Generated new cluster ID: 536de27bcdb5405da73e7d231136dd75
I20260812 11:11:16.854751 18222 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:11:16.876830 18222 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:11:16.878289 18222 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:11:16.888067 18222 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2: Generated new TSK 0
I20260812 11:11:16.889096 18222 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:11:16.969338 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:40269
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:11:17.340396 18243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:17.340715 18243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:17.340813 18243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:17.348351 18243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:17.348474 18243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:17.348589 18243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:11:17.358755 18243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:40269
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:17.360113 18243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:17.361508 18243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:17.375051 18258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:17.375108 18252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:17.375533 18253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:17.375877 18243 server_base.cc:1034] running on GCE node
I20260812 11:11:17.376511 18243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:17.377513 18243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:17.378724 18243 hybrid_clock.cc:648] HybridClock initialized: now 1786533077378667 us; error 49 us; skew 500 ppm
I20260812 11:11:17.379024 18243 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:17 dist-test-slave-rmhg krb5kdc[18080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533077, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:17.382292 18243 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:11:17.383921 18243 webserver.cc:460] Webserver started at http://127.4.26.65:44181/ using document root <none> and password file <none>
I20260812 11:11:17.384755 18243 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:17.384902 18243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:17.385279 18243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:17.388671 18243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "bc6033cb1f694fb79dcd75773dfbc8be"
format_stamp: "Formatted at 2026-08-12 11:11:17 on dist-test-slave-rmhg"
server_key: "cf251dfe26ff56883dc338cc22245be4"
server_key_iv: "a5fbe012e4ef57956d7f8c30a6c14703"
server_key_version: "encryptionkey@0"
I20260812 11:11:17.389544 18243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "bc6033cb1f694fb79dcd75773dfbc8be"
format_stamp: "Formatted at 2026-08-12 11:11:17 on dist-test-slave-rmhg"
server_key: "cf251dfe26ff56883dc338cc22245be4"
server_key_iv: "a5fbe012e4ef57956d7f8c30a6c14703"
server_key_version: "encryptionkey@0"
I20260812 11:11:17.395154 18243 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:11:17.399016 18271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:17.400555 18243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:11:17.400727 18243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "bc6033cb1f694fb79dcd75773dfbc8be"
format_stamp: "Formatted at 2026-08-12 11:11:17 on dist-test-slave-rmhg"
server_key: "cf251dfe26ff56883dc338cc22245be4"
server_key_iv: "a5fbe012e4ef57956d7f8c30a6c14703"
server_key_version: "encryptionkey@0"
I20260812 11:11:17.400950 18243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:17.434005 18243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:17.438601 18243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:17.438858 18243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:17.439845 18243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:11:17.441223 18243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:17.441300 18243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:17.441402 18243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:17.441450 18243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:17.470989 18243 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:46547
I20260812 11:11:17.471031 18462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:46547 every 8 connection(s)
I20260812 11:11:17.472347 18243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:11:17.481029 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 18243
I20260812 11:11:17.481302 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:11:17.481989 4201 external_mini_cluster.cc:1428] Setting key e50f37d40cd57ca217e912e6080e71ce
Aug 12 11:11:17 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533077, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:11:17.494637 18469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:17.475005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:57115 (local address 127.4.26.126:40269)
0812 11:11:17.475471 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:17.475476 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:17.476485 (+ 1009us) server_negotiation.cc:407] Connection header received
0812 11:11:17.478413 (+ 1928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:17.478418 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:17.478530 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:17.478645 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:17.480189 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:17.481190 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:17.483172 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:17.483682 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:17.483821 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:17.488278 (+ 4457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:17.488285 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:17.488289 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:17.488331 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:17.491406 (+ 3075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:17.492187 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:17.492194 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:17.492197 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:17.492346 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:17.492770 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:17.492775 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:17.492778 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:17.493122 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:17.493289 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:17.494139 (+ 850us) server_negotiation.cc:299] Negotiation successful
0812 11:11:17.494333 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":350,"thread_start_us":231,"threads_started":1}
I20260812 11:11:17.496053 18470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:17.475593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:57115)
0812 11:11:17.476294 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:17.476347 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:17.478120 (+ 1773us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:17.478885 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:17.478893 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:17.479408 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:17.480003 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:17.480021 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:17.481398 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:17.481403 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:17.483012 (+ 1609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:17.483036 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:17.483964 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:17.483974 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:17.484316 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:17.485567 (+ 1251us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:17.485599 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:17.488003 (+ 2404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:17.491568 (+ 3565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:17.491576 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:17.491593 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:17.492061 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:17.492446 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:17.492449 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:17.492452 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:17.492672 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:17.493256 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:17.493262 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:17.493641 (+ 379us) client_negotiation.cc:769] Sending connection context
0812 11:11:17.494029 (+ 388us) client_negotiation.cc:240] Negotiation successful
0812 11:11:17.494615 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":272,"threads_started":1}
I20260812 11:11:17.498369 18467 heartbeater.cc:347] Connected to a master server at 127.4.26.126:40269
I20260812 11:11:17.498741 18467 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:17.499715 18467 heartbeater.cc:511] Master 127.4.26.126:40269 requested a full tablet report, sending...
I20260812 11:11:17.502168 18154 ts_manager.cc:194] Registered new tserver with Master: bc6033cb1f694fb79dcd75773dfbc8be (127.4.26.65:46547)
I20260812 11:11:17.503690 18154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:57115
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:11:17.540066 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:40269
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:11:17.886866 18477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:17.887153 18477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:17.887281 18477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:17.894701 18477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:17.894814 18477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:17.894960 18477 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:11:17.905169 18477 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:40269
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:17.906574 18477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:17.907923 18477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:17.921046 18487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:17.921066 18493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:17.921025 18495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:17.921911 18477 server_base.cc:1034] running on GCE node
I20260812 11:11:17.922549 18477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:17.923547 18477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:17.924760 18477 hybrid_clock.cc:648] HybridClock initialized: now 1786533077924710 us; error 47 us; skew 500 ppm
I20260812 11:11:17.925123 18477 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:17 dist-test-slave-rmhg krb5kdc[18080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533077, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:17.928315 18477 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:11:17.929880 18477 webserver.cc:460] Webserver started at http://127.4.26.66:39289/ using document root <none> and password file <none>
I20260812 11:11:17.930586 18477 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:17.930711 18477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:17.931047 18477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:17.934269 18477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "19c61ead2408464b88395ad538036709"
format_stamp: "Formatted at 2026-08-12 11:11:17 on dist-test-slave-rmhg"
server_key: "ed0605bd6b33f7238099df93a0ffc60b"
server_key_iv: "34b32c86115837ad1c7d9b890006ac15"
server_key_version: "encryptionkey@0"
I20260812 11:11:17.935122 18477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "19c61ead2408464b88395ad538036709"
format_stamp: "Formatted at 2026-08-12 11:11:17 on dist-test-slave-rmhg"
server_key: "ed0605bd6b33f7238099df93a0ffc60b"
server_key_iv: "34b32c86115837ad1c7d9b890006ac15"
server_key_version: "encryptionkey@0"
I20260812 11:11:17.940619 18477 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:11:17.944296 18506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:17.945806 18477 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:11:17.945973 18477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "19c61ead2408464b88395ad538036709"
format_stamp: "Formatted at 2026-08-12 11:11:17 on dist-test-slave-rmhg"
server_key: "ed0605bd6b33f7238099df93a0ffc60b"
server_key_iv: "34b32c86115837ad1c7d9b890006ac15"
server_key_version: "encryptionkey@0"
I20260812 11:11:17.946190 18477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:17.966704 18477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:17.971395 18477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:17.971702 18477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:17.972718 18477 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:11:17.974233 18477 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:17.974318 18477 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:17.974445 18477 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:17.974500 18477 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:18.005939 18477 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:43347
I20260812 11:11:18.005971 18703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:43347 every 8 connection(s)
I20260812 11:11:18.007273 18477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:11:18.016990 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 18477
I20260812 11:11:18.017143 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:11:18.017630 4201 external_mini_cluster.cc:1428] Setting key c72c2f974119dd09aab3f5b98ad5ec21
Aug 12 11:11:18 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533077, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:11:18.028862 18707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:18.009806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:47729 (local address 127.4.26.126:40269)
0812 11:11:18.010245 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:18.010250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:18.011357 (+ 1107us) server_negotiation.cc:407] Connection header received
0812 11:11:18.013182 (+ 1825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:18.013188 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:18.013262 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:18.013359 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:18.014843 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:18.015573 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:18.017334 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:18.017791 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:18.017921 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:18.022051 (+ 4130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:18.022058 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:18.022063 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:18.022105 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:18.025416 (+ 3311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:18.026303 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:18.026309 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:18.026312 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:18.026479 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:18.026914 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:18.026918 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:18.026920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:18.027280 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:18.027420 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:18.028212 (+ 792us) server_negotiation.cc:299] Negotiation successful
0812 11:11:18.028470 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":204,"threads_started":1}
I20260812 11:11:18.030241 18709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:18.010476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:47729)
0812 11:11:18.011185 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:18.011224 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:18.012880 (+ 1656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:18.013586 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:18.013594 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:18.014121 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:18.014681 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:18.014701 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:18.015749 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:18.015753 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:18.017090 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:18.017107 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:18.018029 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:18.018037 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:18.018332 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:18.019027 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:18.019063 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:18.021785 (+ 2722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:18.025608 (+ 3823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:18.025617 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:18.025635 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:18.026156 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:18.026586 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:18.026589 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:18.026592 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:18.026808 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:18.027397 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:18.027403 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:18.027771 (+ 368us) client_negotiation.cc:769] Sending connection context
0812 11:11:18.028097 (+ 326us) client_negotiation.cc:240] Negotiation successful
0812 11:11:18.028696 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":255,"threads_started":1}
I20260812 11:11:18.031924 18704 heartbeater.cc:347] Connected to a master server at 127.4.26.126:40269
I20260812 11:11:18.032281 18704 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:18.033243 18704 heartbeater.cc:511] Master 127.4.26.126:40269 requested a full tablet report, sending...
I20260812 11:11:18.035005 18154 ts_manager.cc:194] Registered new tserver with Master: 19c61ead2408464b88395ad538036709 (127.4.26.66:43347)
I20260812 11:11:18.036144 18154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:47729
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:11:18.078693 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:40269
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:11:18.421759 18714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:18.422036 18714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:18.422169 18714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:18.429853 18714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:18.429965 18714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:18.430128 18714 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:11:18.440074 18714 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:40269
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:18.441442 18714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:18.442811 18714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:18.456841 18723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:18.456777 18727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:18.456748 18722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:18.462781 18714 server_base.cc:1034] running on GCE node
I20260812 11:11:18.463478 18714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:18.464550 18714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:18.465754 18714 hybrid_clock.cc:648] HybridClock initialized: now 1786533078465701 us; error 42 us; skew 500 ppm
I20260812 11:11:18.466075 18714 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:18 dist-test-slave-rmhg krb5kdc[18080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533078, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:18.469137 18714 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:11:18.470768 18714 webserver.cc:460] Webserver started at http://127.4.26.67:43479/ using document root <none> and password file <none>
I20260812 11:11:18.471477 18714 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:18.471593 18714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:18.471890 18714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:18.474874 18714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "f48a88b5a6d6483fbea6afbe8c1fa63a"
format_stamp: "Formatted at 2026-08-12 11:11:18 on dist-test-slave-rmhg"
server_key: "5427df3156c86a6ece7052724b103ab2"
server_key_iv: "834cc00b7bba06189f2d9c5ae1b018bc"
server_key_version: "encryptionkey@0"
I20260812 11:11:18.475637 18714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "f48a88b5a6d6483fbea6afbe8c1fa63a"
format_stamp: "Formatted at 2026-08-12 11:11:18 on dist-test-slave-rmhg"
server_key: "5427df3156c86a6ece7052724b103ab2"
server_key_iv: "834cc00b7bba06189f2d9c5ae1b018bc"
server_key_version: "encryptionkey@0"
I20260812 11:11:18.480659 18714 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260812 11:11:18.484057 18737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:18.485486 18714 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:11:18.485648 18714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "f48a88b5a6d6483fbea6afbe8c1fa63a"
format_stamp: "Formatted at 2026-08-12 11:11:18 on dist-test-slave-rmhg"
server_key: "5427df3156c86a6ece7052724b103ab2"
server_key_iv: "834cc00b7bba06189f2d9c5ae1b018bc"
server_key_version: "encryptionkey@0"
I20260812 11:11:18.485834 18714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:18.507648 18467 heartbeater.cc:503] Master 127.4.26.126:40269 was elected leader, sending a full tablet report...
I20260812 11:11:18.526258 18714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:18.530756 18714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:18.531106 18714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:18.532222 18714 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:11:18.533730 18714 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:18.533812 18714 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:18.533908 18714 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:18.533955 18714 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:18.565578 18714 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:45993
I20260812 11:11:18.565608 18936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:45993 every 8 connection(s)
I20260812 11:11:18.566937 18714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:11:18.575932 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 18714
I20260812 11:11:18.576107 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:11:18.576526 4201 external_mini_cluster.cc:1428] Setting key 7e0df51b7ce24044e45a7858613a1098
Aug 12 11:11:18 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533078, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:11:18.588693 18942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:18.569704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:58047 (local address 127.4.26.126:40269)
0812 11:11:18.570219 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:18.570226 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:18.571156 (+ 930us) server_negotiation.cc:407] Connection header received
0812 11:11:18.573087 (+ 1931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:18.573092 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:18.573213 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:18.573316 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:18.574880 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:18.575725 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:18.577729 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:18.578379 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:18.578531 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:18.582568 (+ 4037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:18.582573 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:18.582577 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:18.582616 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:18.585363 (+ 2747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:18.586251 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:18.586256 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:18.586258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:18.586397 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:18.586904 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:18.586908 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:18.586911 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:18.587219 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:18.587352 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:18.588148 (+ 796us) server_negotiation.cc:299] Negotiation successful
0812 11:11:18.588346 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":226,"threads_started":1}
I20260812 11:11:18.589844 18944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:18.570256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:58047)
0812 11:11:18.570977 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:18.571026 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:18.572814 (+ 1788us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:18.573515 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:18.573523 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:18.574076 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:18.574701 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:18.574721 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:18.575901 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:18.575905 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:18.577541 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:18.577561 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:18.578705 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:18.578717 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:18.579004 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:18.579835 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:18.579868 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:18.582304 (+ 2436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:18.585566 (+ 3262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:18.585575 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:18.585593 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:18.586102 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:18.586559 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:18.586562 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:18.586565 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:18.586772 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:18.587367 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:18.587373 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:18.587750 (+ 377us) client_negotiation.cc:769] Sending connection context
0812 11:11:18.588011 (+ 261us) client_negotiation.cc:240] Negotiation successful
0812 11:11:18.588519 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":303,"threads_started":1}
I20260812 11:11:18.591558 18937 heartbeater.cc:347] Connected to a master server at 127.4.26.126:40269
I20260812 11:11:18.591928 18937 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:18.592780 18937 heartbeater.cc:511] Master 127.4.26.126:40269 requested a full tablet report, sending...
I20260812 11:11:18.594327 18154 ts_manager.cc:194] Registered new tserver with Master: f48a88b5a6d6483fbea6afbe8c1fa63a (127.4.26.67:45993)
I20260812 11:11:18.595304 18154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:58047
I20260812 11:11:18.605248 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.65.keytab.
Entry for principal oryx/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.65.keytab.
WARNING: no policy specified for oryx/127.4.26.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.26.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.66.keytab.
Entry for principal oryx/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.66.keytab.
WARNING: no policy specified for oryx/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.67.keytab.
Entry for principal oryx/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.67.keytab.
I20260812 11:11:18.760325 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 18243
Aug 12 11:11:18 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:11:18.778955 18959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:18.761711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50032 (local address 127.4.26.65:46547)
0812 11:11:18.762422 (+ 711us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:18.762429 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:18.762463 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:11:18.762529 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:18.762536 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:18.762766 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:18.762914 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:18.764668 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:18.765865 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:18.767330 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:18.767970 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:18.768107 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:18.772497 (+ 4390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:18.772513 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:18.772531 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:18.772593 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:18.775724 (+ 3131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:18.776660 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:18.776670 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:18.776672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:18.776833 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:18.777241 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:18.777244 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:18.777247 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:18.777688 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:18.777946 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:18.778344 (+ 398us) server_negotiation.cc:299] Negotiation successful
0812 11:11:18.778590 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":379,"threads_started":1}
I20260812 11:11:18.780392 18454 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:18.865988 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 18243
I20260812 11:11:18.889691 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 18477
Aug 12 11:11:18 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:11:18.907605 18963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:18.890734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33340 (local address 127.4.26.66:43347)
0812 11:11:18.891326 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:18.891334 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:18.891361 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:11:18.891429 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:18.891435 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:18.891648 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:18.891791 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:18.893308 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:18.894517 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:18.895954 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:18.896606 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:18.896734 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:18.901361 (+ 4627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:18.901380 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:18.901399 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:18.901464 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:18.904561 (+ 3097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:18.905445 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:18.905455 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:18.905457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:18.905601 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:18.905995 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:18.905998 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:18.905999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:18.906401 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:18.906698 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:18.906987 (+ 289us) server_negotiation.cc:299] Negotiation successful
0812 11:11:18.907227 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":275,"threads_started":1}
I20260812 11:11:18.909054 18696 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:18.992064 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 18477
I20260812 11:11:19.010507 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 18714
Aug 12 11:11:19 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:11:19.027729 18968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:19.011589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48750 (local address 127.4.26.67:45993)
0812 11:11:19.012143 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:19.012151 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:19.012181 (+ 30us) server_negotiation.cc:407] Connection header received
0812 11:11:19.012241 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:19.012248 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:19.012462 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:19.012619 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:19.013932 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:19.014939 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:19.016178 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:19.016792 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:19.016893 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:19.021809 (+ 4916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:19.021829 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:19.021848 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:19.021900 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:19.024988 (+ 3088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:19.025771 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:19.025780 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:19.025782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:19.025919 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:19.026258 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:19.026262 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:19.026264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:19.026693 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:19.026929 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:19.027168 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 11:11:19.027386 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":280,"threads_started":1}
I20260812 11:11:19.029064 18929 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:19.111562 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 18714
I20260812 11:11:19.136474 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 18103
I20260812 11:11:19.137777 18199 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:19.241305 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 18103
I20260812 11:11:19.267776 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:40269
--webserver_interface=127.4.26.126
--webserver_port=33389
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:40269
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:11:19.608757 18974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:19.609118 18974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:19.609288 18974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:19.616729 18974 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:11:19.616856 18974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:19.616905 18974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:19.616963 18974 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:11:19.617010 18974 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:11:19.627806 18974 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:40269
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:40269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=33389
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:19.629256 18974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:19.630646 18974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:19.642581 18982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:19.642627 18984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:19.642684 18981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:19.643261 18974 server_base.cc:1034] running on GCE node
I20260812 11:11:19.644052 18974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:19.645558 18974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:19.646792 18974 hybrid_clock.cc:648] HybridClock initialized: now 1786533079646722 us; error 51 us; skew 500 ppm
I20260812 11:11:19.647146 18974 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:19 dist-test-slave-rmhg krb5kdc[18080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533079, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:19.650333 18974 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:11:19.651976 18974 webserver.cc:460] Webserver started at http://127.4.26.126:33389/ using document root <none> and password file <none>
I20260812 11:11:19.652717 18974 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:19.652838 18974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:19.658540 18974 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:11:19.661685 18994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:19.663160 18974 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:11:19.663340 18974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "0fde40194484436190d466f0d75ee8b2"
format_stamp: "Formatted at 2026-08-12 11:11:16 on dist-test-slave-rmhg"
server_key: "17e0c05235e979bce12eb900d3d016ba"
server_key_iv: "d45081119abf0b406316d79c6e2944f9"
server_key_version: "encryptionkey@0"
I20260812 11:11:19.664366 18974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:19.688120 18974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:19.692633 18974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:19.692997 18974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:19.712044 18974 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:40269
I20260812 11:11:19.712081 19077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:40269 every 8 connection(s)
I20260812 11:11:19.713798 18974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:11:19.721207 19078 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:11:19.723953 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 18974
I20260812 11:11:19.724756 19078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2: Bootstrap starting.
I20260812 11:11:19.724807 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:46547
--local_ip_for_outbound_sockets=127.4.26.65
--tserver_master_addrs=127.4.26.126:40269
--webserver_port=44181
--webserver_interface=127.4.26.65
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.4.26.65
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:11:19.747690 19078 log.cc:824] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2: Log is configured to *not* fsync() on all Append() calls
I20260812 11:11:19.760679 19078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:11:19.761452 19078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2: Bootstrap complete.
I20260812 11:11:19.775730 19078 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fde40194484436190d466f0d75ee8b2" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40269 } }
I20260812 11:11:19.777058 19078 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fde40194484436190d466f0d75ee8b2, State: Initialized, Role: FOLLOWER
I20260812 11:11:19.777936 19078 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fde40194484436190d466f0d75ee8b2" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40269 } }
I20260812 11:11:19.778254 19078 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:11:19.778396 19078 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:11:19.778595 19078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:11:19.785081 19078 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fde40194484436190d466f0d75ee8b2" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40269 } }
I20260812 11:11:19.785882 19078 leader_election.cc:302] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fde40194484436190d466f0d75ee8b2; no voters:
I20260812 11:11:19.786621 19078 leader_election.cc:288] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 11:11:19.786788 19085 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:11:19.788101 19085 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [term 2 LEADER]: Becoming Leader. State: Replica: 0fde40194484436190d466f0d75ee8b2, State: Running, Role: LEADER
I20260812 11:11:19.788734 19085 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fde40194484436190d466f0d75ee8b2" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40269 } }
I20260812 11:11:19.789141 19078 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:11:19.791424 19086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0fde40194484436190d466f0d75ee8b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fde40194484436190d466f0d75ee8b2" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40269 } } }
I20260812 11:11:19.791924 19086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [sys.catalog]: This master's current role is: LEADER
I20260812 11:11:19.791440 19087 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fde40194484436190d466f0d75ee8b2. Latest consensus state: current_term: 2 leader_uuid: "0fde40194484436190d466f0d75ee8b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fde40194484436190d466f0d75ee8b2" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40269 } } }
I20260812 11:11:19.792098 19087 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2 [sys.catalog]: This master's current role is: LEADER
I20260812 11:11:19.801954 19090 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:11:19.808513 19090 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:11:19.810345 19090 catalog_manager.cc:1259] Loaded cluster ID: 536de27bcdb5405da73e7d231136dd75
I20260812 11:11:19.810571 19090 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:11:19.814996 19090 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:11:19.816825 19090 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0fde40194484436190d466f0d75ee8b2: Loaded TSK: 0
I20260812 11:11:19.818783 19090 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:11:20.115757 19082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:20.116042 19082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:20.116164 19082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:20.123497 19082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:20.123642 19082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:20.123812 19082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:11:20.134100 19082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.65.keytab
--principal=oryx/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:46547
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=44181
--tserver_master_addrs=127.4.26.126:40269
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:20.135480 19082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:20.137192 19082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:20.151336 19117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:20.151351 19118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:20.151909 19120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:20.152406 19082 server_base.cc:1034] running on GCE node
I20260812 11:11:20.153019 19082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:20.154070 19082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:20.155304 19082 hybrid_clock.cc:648] HybridClock initialized: now 1786533080155252 us; error 52 us; skew 500 ppm
I20260812 11:11:20.155635 19082 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:20 dist-test-slave-rmhg krb5kdc[18080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533080, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:20.158913 19082 init.cc:377] Logged in from keytab as oryx/127.4.26.65@KRBTEST.COM (short username oryx)
I20260812 11:11:20.160467 19082 webserver.cc:460] Webserver started at http://127.4.26.65:44181/ using document root <none> and password file <none>
I20260812 11:11:20.161239 19082 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:20.161381 19082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:20.167152 19082 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260812 11:11:20.170076 19135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:20.171389 19082 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:11:20.171545 19082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "bc6033cb1f694fb79dcd75773dfbc8be"
format_stamp: "Formatted at 2026-08-12 11:11:17 on dist-test-slave-rmhg"
server_key: "cf251dfe26ff56883dc338cc22245be4"
server_key_iv: "a5fbe012e4ef57956d7f8c30a6c14703"
server_key_version: "encryptionkey@0"
I20260812 11:11:20.172536 19082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:20.214109 19082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:20.218730 19082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:20.219026 19082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:20.220065 19082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:11:20.221621 19082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:20.221724 19082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:20.221832 19082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:20.221905 19082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:20.253531 19082 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:46547
I20260812 11:11:20.253607 19311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:46547 every 8 connection(s)
I20260812 11:11:20.255057 19082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:11:20.258528 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 19082
I20260812 11:11:20.259385 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:43347
--local_ip_for_outbound_sockets=127.4.26.66
--tserver_master_addrs=127.4.26.126:40269
--webserver_port=39289
--webserver_interface=127.4.26.66
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.4.26.66
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:11:20 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:20 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:20.277225 19318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:20.258141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:54589)
0812 11:11:20.261771 (+ 3630us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:20.261818 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:20.263636 (+ 1818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:20.265254 (+ 1618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:20.265266 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:20.265898 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:20.266546 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:20.266568 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.268217 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.268221 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:20.269669 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:20.269682 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.270732 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.270740 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:20.271017 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:20.271733 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:20.271759 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:20.275731 (+ 3972us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":3339,"thread_start_us":3120,"threads_started":1}
W20260812 11:11:20.277267 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:20.258076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:54589 (local address 127.4.26.126:40269)
0812 11:11:20.258908 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:20.258921 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:20.261996 (+ 3075us) server_negotiation.cc:407] Connection header received
0812 11:11:20.264257 (+ 2261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:20.264272 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:20.264666 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:20.265051 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:20.266760 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.268049 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.269814 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.270488 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.270671 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:20.276180 (+ 5509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:54589: BlockingRecv error: recv got EOF from 127.4.26.65:54589 (error 108)
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":300,"threads_started":1}
W20260812 11:11:20.278194 19312 heartbeater.cc:644] Failed to heartbeat to 127.4.26.126:40269 (0 consecutive failures): Not authorized: Failed to ping master at 127.4.26.126:40269: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Aug 12 11:11:20 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:20 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:20.287802 19318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:20.278842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:44159)
0812 11:11:20.279043 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:20.279065 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:20.279202 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:20.279529 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:20.279534 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:20.279987 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:20.280206 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:20.280219 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.281343 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.281349 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:20.282772 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:20.282790 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.283511 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.283517 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:20.283703 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:20.284320 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:20.284344 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:20.287583 (+ 3239us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":57}
W20260812 11:11:20.288239 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:20.279110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:44159 (local address 127.4.26.126:40269)
0812 11:11:20.279257 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:20.279261 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:20.279278 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:11:20.279332 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:20.279336 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:20.279395 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:20.279519 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:20.280368 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.281195 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.282945 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.283357 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.283463 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:20.287843 (+ 4380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:44159: BlockingRecv error: recv got EOF from 127.4.26.65:44159 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 12 11:11:20 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:20 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:20.297071 19318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:20.288532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:51729)
0812 11:11:20.288786 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:20.288806 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:20.288908 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:20.289368 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:20.289371 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:20.289655 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:20.289799 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:20.289807 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.291301 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.291305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:20.292249 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:20.292261 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.293179 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.293186 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:20.293353 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:20.293925 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:20.293943 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:20.296779 (+ 2836us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139}
W20260812 11:11:20.297501 19312 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:11:20.297695 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:20.288811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:51729 (local address 127.4.26.126:40269)
0812 11:11:20.288991 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:20.288997 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:20.289044 (+ 47us) server_negotiation.cc:407] Connection header received
0812 11:11:20.289101 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:20.289107 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:20.289243 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:20.289343 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:20.289915 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.291159 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.292382 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.293011 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.293125 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:20.296981 (+ 3856us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:51729: BlockingRecv error: recv got EOF from 127.4.26.65:51729 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260812 11:11:20.613445 19320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:20.613752 19320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:20.613853 19320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:20.621140 19320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:20.621306 19320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:20.621428 19320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:11:20.631392 19320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.66.keytab
--principal=oryx/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:43347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=39289
--tserver_master_addrs=127.4.26.126:40269
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:20.632727 19320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:20.634047 19320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:20.647543 19328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:20.647511 19330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:20.647475 19333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:20.648744 19320 server_base.cc:1034] running on GCE node
I20260812 11:11:20.649520 19320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:20.650780 19320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:20.652032 19320 hybrid_clock.cc:648] HybridClock initialized: now 1786533080651979 us; error 49 us; skew 500 ppm
I20260812 11:11:20.652388 19320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:20 dist-test-slave-rmhg krb5kdc[18080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533080, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:20.655774 19320 init.cc:377] Logged in from keytab as oryx/127.4.26.66@KRBTEST.COM (short username oryx)
I20260812 11:11:20.657315 19320 webserver.cc:460] Webserver started at http://127.4.26.66:39289/ using document root <none> and password file <none>
I20260812 11:11:20.658066 19320 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:20.658187 19320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:20.664148 19320 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:11:20.667464 19343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:20.669068 19320 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:11:20.669296 19320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "19c61ead2408464b88395ad538036709"
format_stamp: "Formatted at 2026-08-12 11:11:17 on dist-test-slave-rmhg"
server_key: "ed0605bd6b33f7238099df93a0ffc60b"
server_key_iv: "34b32c86115837ad1c7d9b890006ac15"
server_key_version: "encryptionkey@0"
I20260812 11:11:20.670388 19320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:20.683477 19320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:20.687917 19320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:20.688192 19320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:20.689294 19320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:11:20.690811 19320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:20.690912 19320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:20.690996 19320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:20.691057 19320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:20.724864 19320 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:43347
I20260812 11:11:20.724947 19519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:43347 every 8 connection(s)
I20260812 11:11:20.726476 19320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:11:20.732057 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 19320
I20260812 11:11:20.732831 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:45993
--local_ip_for_outbound_sockets=127.4.26.67
--tserver_master_addrs=127.4.26.126:40269
--webserver_port=43479
--webserver_interface=127.4.26.67
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.4.26.67
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:11:20 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:20 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:11:20.745608 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:20.729447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:52917 (local address 127.4.26.126:40269)
0812 11:11:20.729644 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:20.729648 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:20.730832 (+ 1184us) server_negotiation.cc:407] Connection header received
0812 11:11:20.733435 (+ 2603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:20.733440 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:20.733518 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:20.733623 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:20.735879 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.736623 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.738943 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.739410 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.739514 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:20.745417 (+ 5903us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:52917: BlockingRecv error: recv got EOF from 127.4.26.66:52917 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:11:20.746583 19522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:20.729849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:52917)
0812 11:11:20.730640 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:20.730684 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:20.733055 (+ 2371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:20.733950 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:20.733964 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:20.734764 (+ 800us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:20.735643 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:20.735672 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.736803 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.736808 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:20.738762 (+ 1954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:20.738780 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.739665 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.739672 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:20.739986 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:20.740782 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:20.740811 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:20.745194 (+ 4383us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":292,"threads_started":1}
W20260812 11:11:20.747350 19520 heartbeater.cc:644] Failed to heartbeat to 127.4.26.126:40269 (0 consecutive failures): Not authorized: Failed to ping master at 127.4.26.126:40269: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Aug 12 11:11:20 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:20 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:20.756183 19522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:20.747939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:58163)
0812 11:11:20.748121 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:20.748143 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:20.748257 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:20.748562 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:20.748566 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:20.748930 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:20.749082 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:20.749100 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.750205 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.750210 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:20.751123 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:20.751137 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.751844 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.751850 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:20.752022 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:20.752664 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:20.752681 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:20.755847 (+ 3166us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 11:11:20.756462 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:20.748082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:58163 (local address 127.4.26.126:40269)
0812 11:11:20.748251 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:20.748257 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:20.748277 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:11:20.748366 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:20.748372 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:20.748437 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:20.748516 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:20.749270 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.750057 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.751274 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.751696 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.751812 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:20.756091 (+ 4279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:58163: BlockingRecv error: recv got EOF from 127.4.26.66:58163 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 12 11:11:20 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:20 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:20.765053 19522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:20.757171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:48885)
0812 11:11:20.757342 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:20.757362 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:20.757476 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:20.757819 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:20.757824 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:20.758153 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:20.758316 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:20.758325 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.759336 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.759341 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:20.760257 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:20.760271 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.761010 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.761016 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:20.761240 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:20.761840 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:20.761856 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:20.764737 (+ 2881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 11:11:20.765456 19520 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:11:20.765671 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:20.757312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:48885 (local address 127.4.26.126:40269)
0812 11:11:20.757486 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:20.757491 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:20.757510 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:11:20.757575 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:20.757580 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:20.757684 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:20.757772 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:20.758457 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.759197 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.760399 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:20.760862 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:20.760980 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:20.765023 (+ 4043us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:48885: BlockingRecv error: recv got EOF from 127.4.26.66:48885 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260812 11:11:21.093595 19525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:21.093950 19525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:21.094082 19525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:21.101676 19525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:21.101822 19525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:21.101984 19525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:11:21.112489 19525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/krb5kdc/oryx_127.4.26.67.keytab
--principal=oryx/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:45993
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=43479
--tserver_master_addrs=127.4.26.126:40269
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:21.114032 19525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:21.115527 19525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:21.130142 19539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:21.130106 19535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:21.130169 19543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:21.131088 19525 server_base.cc:1034] running on GCE node
I20260812 11:11:21.131778 19525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:21.132884 19525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:21.134128 19525 hybrid_clock.cc:648] HybridClock initialized: now 1786533081134046 us; error 75 us; skew 500 ppm
I20260812 11:11:21.134481 19525 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:21 dist-test-slave-rmhg krb5kdc[18080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533081, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:21.137945 19525 init.cc:377] Logged in from keytab as oryx/127.4.26.67@KRBTEST.COM (short username oryx)
I20260812 11:11:21.139470 19525 webserver.cc:460] Webserver started at http://127.4.26.67:43479/ using document root <none> and password file <none>
I20260812 11:11:21.140240 19525 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:21.140368 19525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:21.146272 19525 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260812 11:11:21.149359 19553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:21.151051 19525 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:11:21.151265 19525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "f48a88b5a6d6483fbea6afbe8c1fa63a"
format_stamp: "Formatted at 2026-08-12 11:11:18 on dist-test-slave-rmhg"
server_key: "5427df3156c86a6ece7052724b103ab2"
server_key_iv: "834cc00b7bba06189f2d9c5ae1b018bc"
server_key_version: "encryptionkey@0"
I20260812 11:11:21.152420 19525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:21.167279 19525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:21.172639 19525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:21.172945 19525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:21.174168 19525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:11:21.175632 19525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:21.175740 19525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:21.175887 19525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:21.175971 19525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:21.207803 19525 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:45993
I20260812 11:11:21.207864 19736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:45993 every 8 connection(s)
I20260812 11:11:21.209443 19525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:11:21.213917 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 19525
Aug 12 11:11:21 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:21 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:11:21.228626 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:21.212353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:42777 (local address 127.4.26.126:40269)
0812 11:11:21.212639 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:21.212646 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:21.214264 (+ 1618us) server_negotiation.cc:407] Connection header received
0812 11:11:21.216544 (+ 2280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:21.216549 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:21.216616 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:21.216722 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:21.218443 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.219345 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.221616 (+ 2271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.222151 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.222259 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:21.228288 (+ 6029us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:42777: BlockingRecv error: recv got EOF from 127.4.26.67:42777 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:11:21.229367 19740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:21.212928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:42777)
0812 11:11:21.214034 (+ 1106us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:21.214096 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:21.216265 (+ 2169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:21.216958 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:21.216967 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:21.217621 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:21.218267 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:21.218287 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.219522 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.219528 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:21.221447 (+ 1919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:21.221463 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.222407 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.222415 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:21.222803 (+ 388us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:21.223522 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:21.223555 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:21.228034 (+ 4479us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":726,"thread_start_us":410,"threads_started":1}
W20260812 11:11:21.230283 19737 heartbeater.cc:644] Failed to heartbeat to 127.4.26.126:40269 (0 consecutive failures): Not authorized: Failed to ping master at 127.4.26.126:40269: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
I20260812 11:11:21.232466 19743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:21.215208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43328 (local address 127.4.26.126:40269)
0812 11:11:21.215911 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:21.215917 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:21.215936 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:11:21.215989 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:21.215993 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:21.216052 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:21.216147 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:21.217962 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.218930 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.220671 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.221196 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.221297 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:21.224744 (+ 3447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:21.224754 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:21.224774 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:21.224815 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:21.228423 (+ 3608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:21.229464 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:21.229473 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:21.229483 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:21.229769 (+ 286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:21.230233 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:21.230237 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:21.230239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:21.230842 (+ 603us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:21.231466 (+ 624us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:21.231738 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 11:11:21.232108 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":451,"threads_started":1}
Aug 12 11:11:21 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:21 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:21.239926 19740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:21.230948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:35159)
0812 11:11:21.231145 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:21.231165 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:21.231281 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:21.231639 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:21.231644 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:21.232046 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:21.232222 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:21.232232 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.233417 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.233423 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:21.234533 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:21.234548 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.235461 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.235468 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:21.235642 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:21.236414 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:21.236440 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:21.239711 (+ 3271us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 11:11:21.240195 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:21.231040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:35159 (local address 127.4.26.126:40269)
0812 11:11:21.231201 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:21.231205 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:21.231220 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:11:21.231416 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:21.231421 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:21.231493 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:21.231592 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:21.232365 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.233279 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.234696 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.235297 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.235429 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:21.239958 (+ 4529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:35159: BlockingRecv error: recv got EOF from 127.4.26.67:35159 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 11:11:21 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:21 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:21.248836 19740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:21.240715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:54207)
0812 11:11:21.240910 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:21.240932 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:21.241040 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:21.241403 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:21.241407 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:21.241708 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:21.241869 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:21.241877 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.242970 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.242974 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:21.243903 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:21.243915 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.244600 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.244605 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:21.244771 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:21.245373 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:21.245393 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:21.248544 (+ 3151us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 11:11:21.249220 19737 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:11:21.249245 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:21.240807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:54207 (local address 127.4.26.126:40269)
0812 11:11:21.241083 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:21.241088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:21.241126 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:11:21.241203 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:21.241208 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:21.241288 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:21.241373 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:21.242013 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.242841 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.244032 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.244470 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.244565 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:21.248749 (+ 4184us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:54207: BlockingRecv error: recv got EOF from 127.4.26.67:54207 (error 108)
Metrics: {"server-negotiator.queue_time_us":172}
Aug 12 11:11:21 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:21 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:21.307574 19745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:21.298316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:59211)
0812 11:11:21.298932 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:21.298949 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:21.299093 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:21.299514 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:21.299518 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:21.300099 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:21.300307 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:21.300317 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.301455 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.301459 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:21.302465 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:21.302478 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.303444 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.303449 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:21.303597 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:21.304200 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:21.304219 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:21.307341 (+ 3122us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":370,"threads_started":1}
W20260812 11:11:21.307891 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:21.298404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:59211 (local address 127.4.26.126:40269)
0812 11:11:21.298613 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:21.298621 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:21.299044 (+ 423us) server_negotiation.cc:407] Connection header received
0812 11:11:21.299264 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:21.299274 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:21.299357 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:21.299470 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:21.300455 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.301287 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.302711 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.303264 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.303374 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:21.307647 (+ 4273us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:59211: BlockingRecv error: recv got EOF from 127.4.26.65:59211 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 12 11:11:21 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:21 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
W20260812 11:11:21.778467 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:21.766220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:48423 (local address 127.4.26.126:40269)
0812 11:11:21.766462 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:21.766468 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:21.766802 (+ 334us) server_negotiation.cc:407] Connection header received
0812 11:11:21.767003 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:21.767007 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:21.767073 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:21.767162 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:21.768097 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.768818 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.770240 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.770671 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.770787 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:21.778247 (+ 7460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:48423: BlockingRecv error: recv got EOF from 127.4.26.66:48423 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 11:11:21.778478 19747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:21.766078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:48423)
0812 11:11:21.766695 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:21.766712 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:21.766857 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:21.767219 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:21.767224 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:21.767734 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:21.767940 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:21.767950 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.768980 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.768984 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:21.770090 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:21.770106 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:21.770861 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:21.770868 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:21.771029 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:21.774398 (+ 3369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:21.774421 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:21.777960 (+ 3539us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":313,"threads_started":1}
Aug 12 11:11:22 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:22 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:22.259264 19752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:22.249926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:38739)
0812 11:11:22.250439 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:22.250455 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:22.250583 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:22.250925 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:22.250928 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:22.251386 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:22.251593 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:22.251632 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:22.252707 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:22.252711 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:22.253893 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:22.253910 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:22.254867 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:22.254875 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:22.255064 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:22.255768 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:22.255793 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:22.259030 (+ 3237us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":270,"threads_started":1}
W20260812 11:11:22.259518 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:22.250011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:38739 (local address 127.4.26.126:40269)
0812 11:11:22.250198 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:22.250203 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:22.250527 (+ 324us) server_negotiation.cc:407] Connection header received
0812 11:11:22.250714 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:22.250718 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:22.250783 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:22.250878 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:22.251775 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:22.252550 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:22.254047 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:22.254673 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:22.254792 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:22.259282 (+ 4490us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:38739: BlockingRecv error: recv got EOF from 127.4.26.67:38739 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 11:11:22 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:22 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:22.317456 19754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:22.308646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:41421)
0812 11:11:22.309224 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:22.309242 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:22.309401 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:22.309747 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:22.309752 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:22.310196 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:22.310362 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:22.310372 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:22.311460 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:22.311465 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:22.312413 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:22.312427 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:22.313139 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:22.313187 (+ 48us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:22.313346 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:22.313962 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:22.313983 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:22.317103 (+ 3120us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":306,"threads_started":1}
W20260812 11:11:22.317646 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:22.308733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:41421 (local address 127.4.26.126:40269)
0812 11:11:22.308970 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:22.308977 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:22.309339 (+ 362us) server_negotiation.cc:407] Connection header received
0812 11:11:22.309526 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:22.309530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:22.309595 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:22.309686 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:22.310523 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:22.311308 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:22.312565 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:22.312979 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:22.313095 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:22.317381 (+ 4286us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:41421: BlockingRecv error: recv got EOF from 127.4.26.65:41421 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 12 11:11:22 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:22 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:22.788735 19757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:22.779641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:53589)
0812 11:11:22.780209 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:22.780228 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:22.780356 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:22.780815 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:22.780819 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:22.781280 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:22.781453 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:22.781463 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:22.782575 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:22.782580 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:22.783543 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:22.783558 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:22.784371 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:22.784376 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:22.784515 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:22.785208 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:22.785228 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:22.788454 (+ 3226us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":310,"threads_started":1}
W20260812 11:11:22.788940 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:22.779701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:53589 (local address 127.4.26.126:40269)
0812 11:11:22.779918 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:22.779926 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:22.780299 (+ 373us) server_negotiation.cc:407] Connection header received
0812 11:11:22.780520 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:22.780524 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:22.780605 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:22.780697 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:22.781691 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:22.782428 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:22.783742 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:22.784216 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:22.784320 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:22.788731 (+ 4411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:53589: BlockingRecv error: recv got EOF from 127.4.26.66:53589 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 12 11:11:23 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:23 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:23.268708 19758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:23.260136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:57857)
0812 11:11:23.260679 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:23.260696 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:23.260839 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:23.261198 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:23.261203 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:23.261662 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:23.261812 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:23.261821 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:23.262986 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:23.262991 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:23.263889 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:23.263902 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:23.264637 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:23.264644 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:23.264792 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:23.265414 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:23.265431 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:23.268441 (+ 3010us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":262,"threads_started":1}
W20260812 11:11:23.268898 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:23.260399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:57857 (local address 127.4.26.126:40269)
0812 11:11:23.260599 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:23.260606 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:23.260775 (+ 169us) server_negotiation.cc:407] Connection header received
0812 11:11:23.260968 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:23.260972 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:23.261035 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:23.261173 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:23.261957 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:23.262842 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:23.264025 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:23.264483 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:23.264592 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:23.268645 (+ 4053us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:57857: BlockingRecv error: recv got EOF from 127.4.26.67:57857 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 12 11:11:23 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:23 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:23.327571 19760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:23.318616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:58739)
0812 11:11:23.319166 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:23.319188 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:23.319322 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:23.319677 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:23.319681 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:23.320078 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:23.320278 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:23.320288 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:23.321469 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:23.321473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:23.322433 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:23.322447 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:23.323174 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:23.323179 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:23.323338 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:23.324124 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:23.324144 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:23.327286 (+ 3142us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":279,"threads_started":1}
W20260812 11:11:23.327811 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:23.318776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:58739 (local address 127.4.26.126:40269)
0812 11:11:23.318974 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:23.318979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:23.319289 (+ 310us) server_negotiation.cc:407] Connection header received
0812 11:11:23.319421 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:23.319425 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:23.319495 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:23.319590 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:23.320459 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:23.321296 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:23.322580 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:23.322998 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:23.323103 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:23.327516 (+ 4413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:58739: BlockingRecv error: recv got EOF from 127.4.26.65:58739 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 12 11:11:23 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:23 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:23.798475 19761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:23.789985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:59619)
0812 11:11:23.790504 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:23.790523 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:23.790675 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:23.791033 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:23.791038 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:23.791412 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:23.791596 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:23.791606 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:23.792684 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:23.792690 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:23.793703 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:23.793717 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:23.794410 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:23.794416 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:23.794599 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:23.795256 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:23.795275 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:23.798203 (+ 2928us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":273,"threads_started":1}
W20260812 11:11:23.798681 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:23.790053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:59619 (local address 127.4.26.126:40269)
0812 11:11:23.790262 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:23.790268 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:23.790606 (+ 338us) server_negotiation.cc:407] Connection header received
0812 11:11:23.790834 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:23.790839 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:23.790903 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:23.790987 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:23.791756 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:23.792536 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:23.793850 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:23.794264 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:23.794392 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:23.798445 (+ 4053us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:59619: BlockingRecv error: recv got EOF from 127.4.26.66:59619 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 12 11:11:24 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:24 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:24.278294 19762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:24.269707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:56607)
0812 11:11:24.270195 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:24.270211 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:24.270348 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:24.270706 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:24.270712 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:24.271069 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:24.271254 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:24.271264 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:24.272271 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:24.272275 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:24.273237 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:24.273251 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:24.273977 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:24.273983 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:24.274178 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:24.274844 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:24.274865 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:24.277996 (+ 3131us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":268,"threads_started":1}
W20260812 11:11:24.278623 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:24.269853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:56607 (local address 127.4.26.126:40269)
0812 11:11:24.270064 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:24.270070 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:24.270287 (+ 217us) server_negotiation.cc:407] Connection header received
0812 11:11:24.270471 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:24.270477 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:24.270547 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:24.270632 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:24.271397 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:24.272120 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:24.273370 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:24.273838 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:24.273964 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:24.278264 (+ 4300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:56607: BlockingRecv error: recv got EOF from 127.4.26.67:56607 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 12 11:11:24 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:24 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:24.337188 19763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:24.328670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:55823)
0812 11:11:24.329297 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:24.329322 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:24.329469 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:24.329858 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:24.329863 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:24.330393 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:24.330587 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:24.330598 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:24.331658 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:24.331661 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:24.332621 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:24.332633 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:24.333388 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:24.333393 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:24.333523 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:24.334105 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:24.334122 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:24.336911 (+ 2789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":344,"threads_started":1}
W20260812 11:11:24.337430 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:24.328786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:55823 (local address 127.4.26.126:40269)
0812 11:11:24.329024 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:24.329029 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:24.329409 (+ 380us) server_negotiation.cc:407] Connection header received
0812 11:11:24.329593 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:24.329598 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:24.329687 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:24.329803 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:24.330745 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:24.331542 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:24.332777 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:24.333248 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:24.333351 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:24.337179 (+ 3828us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:55823: BlockingRecv error: recv got EOF from 127.4.26.65:55823 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 12 11:11:24 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:24 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:24.808440 19765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:24.799731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:33207)
0812 11:11:24.800356 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:24.800378 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:24.800527 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:24.800884 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:24.800889 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:24.801348 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:24.801509 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:24.801518 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:24.802624 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:24.802628 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:24.803639 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:24.803681 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:24.804415 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:24.804420 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:24.804616 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:24.805225 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:24.805243 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:24.808177 (+ 2934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":363,"threads_started":1}
W20260812 11:11:24.808663 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:24.799879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:33207 (local address 127.4.26.126:40269)
0812 11:11:24.800096 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:24.800103 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:24.800470 (+ 367us) server_negotiation.cc:407] Connection header received
0812 11:11:24.800651 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:24.800657 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:24.800749 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:24.800834 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:24.801649 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:24.802483 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:24.803813 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:24.804273 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:24.804383 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:24.808419 (+ 4036us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:33207: BlockingRecv error: recv got EOF from 127.4.26.66:33207 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 12 11:11:25 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:25 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:25.287616 19767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:25.279299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:33761)
0812 11:11:25.279783 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:25.279800 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:25.279918 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:25.280215 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:25.280218 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:25.280589 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:25.280890 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:25.280902 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:25.282007 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:25.282011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:25.283019 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:25.283031 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:25.283749 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:25.283753 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:25.283884 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:25.284455 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:25.284473 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:25.287363 (+ 2890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":255,"threads_started":1}
W20260812 11:11:25.287832 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:25.279378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:33761 (local address 127.4.26.126:40269)
0812 11:11:25.279563 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:25.279570 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:25.279873 (+ 303us) server_negotiation.cc:407] Connection header received
0812 11:11:25.280012 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:25.280016 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:25.280082 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:25.280165 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:25.281042 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:25.281873 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:25.283154 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:25.283629 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:25.283726 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:25.287589 (+ 3863us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:33761: BlockingRecv error: recv got EOF from 127.4.26.67:33761 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 12 11:11:25 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:25 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:25.346655 19770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:25.338249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:35541)
0812 11:11:25.338717 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:25.338735 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:25.338850 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:25.339253 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:25.339257 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:25.339753 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:25.339923 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:25.339932 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:25.341070 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:25.341074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:25.342057 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:25.342069 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:25.342775 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:25.342781 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:25.342949 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:25.343491 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:25.343508 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:25.346310 (+ 2802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":224,"threads_started":1}
W20260812 11:11:25.346804 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:25.338359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:35541 (local address 127.4.26.126:40269)
0812 11:11:25.338652 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:25.338659 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:25.338810 (+ 151us) server_negotiation.cc:407] Connection header received
0812 11:11:25.338999 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:25.339004 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:25.339070 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:25.339183 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:25.340074 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:25.340938 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:25.342201 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:25.342629 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:25.342749 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:25.346580 (+ 3831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:35541: BlockingRecv error: recv got EOF from 127.4.26.65:35541 (error 108)
Metrics: {"server-negotiator.queue_time_us":114}
Aug 12 11:11:25 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:25 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:25.818804 19771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:25.809614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:50851)
0812 11:11:25.810193 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:25.810212 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:25.810364 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:25.810722 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:25.810727 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:25.811186 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:25.811358 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:25.811368 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:25.812701 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:25.812707 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:25.813921 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:25.813937 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:25.814669 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:25.814675 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:25.814859 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:25.815447 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:25.815472 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:25.818532 (+ 3060us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":277,"threads_started":1}
W20260812 11:11:25.819051 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:25.809956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:50851 (local address 127.4.26.126:40269)
0812 11:11:25.810179 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:25.810187 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:25.810303 (+ 116us) server_negotiation.cc:407] Connection header received
0812 11:11:25.810492 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:25.810498 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:25.810574 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:25.810665 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:25.811531 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:25.812549 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:25.814065 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:25.814519 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:25.814637 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:25.818803 (+ 4166us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:50851: BlockingRecv error: recv got EOF from 127.4.26.66:50851 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 11:11:26 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:26 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:26.297633 19772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:26.288682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:48173)
0812 11:11:26.289284 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:26.289302 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:26.289453 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:26.289840 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:26.289845 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:26.290323 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:26.290495 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:26.290504 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:26.291528 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:26.291532 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:26.292462 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:26.292476 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:26.293292 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:26.293298 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:26.293471 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:26.294076 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:26.294094 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:26.297304 (+ 3210us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":272,"threads_started":1}
W20260812 11:11:26.297765 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:26.288830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:48173 (local address 127.4.26.126:40269)
0812 11:11:26.289064 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:26.289071 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:26.289406 (+ 335us) server_negotiation.cc:407] Connection header received
0812 11:11:26.289590 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:26.289594 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:26.289687 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:26.289785 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:26.290662 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:26.291383 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:26.292620 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:26.293098 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:26.293252 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:26.297526 (+ 4274us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:48173: BlockingRecv error: recv got EOF from 127.4.26.67:48173 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 12 11:11:26 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:26 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:26.356245 19773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:26.347733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:42341)
0812 11:11:26.348247 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:26.348265 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:26.348390 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:26.348809 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:26.348814 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:26.349261 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:26.349433 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:26.349442 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:26.350492 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:26.350496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:26.351426 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:26.351437 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:26.352140 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:26.352145 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:26.352271 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:26.352867 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:26.352884 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:26.355901 (+ 3017us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":276,"threads_started":1}
W20260812 11:11:26.356376 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:26.347835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:42341 (local address 127.4.26.126:40269)
0812 11:11:26.348072 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:26.348079 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:26.348347 (+ 268us) server_negotiation.cc:407] Connection header received
0812 11:11:26.348534 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:26.348539 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:26.348636 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:26.348727 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:26.349573 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:26.350362 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:26.351561 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:26.351991 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:26.352087 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:26.356116 (+ 4029us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:42341: BlockingRecv error: recv got EOF from 127.4.26.65:42341 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 12 11:11:26 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:26 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:26.832852 19775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:26.820008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:60521)
0812 11:11:26.820553 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:26.820572 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:26.820713 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:26.821049 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:26.821052 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:26.821485 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:26.821666 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:26.821675 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:26.822887 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:26.822894 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:26.823870 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:26.823884 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:26.824856 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:26.824863 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:26.825088 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:26.828827 (+ 3739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:26.828850 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:26.832596 (+ 3746us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":297,"threads_started":1}
W20260812 11:11:26.833274 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:26.820215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:60521 (local address 127.4.26.126:40269)
0812 11:11:26.820456 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:26.820463 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:26.820661 (+ 198us) server_negotiation.cc:407] Connection header received
0812 11:11:26.820814 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:26.820818 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:26.820888 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:26.820981 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:26.821870 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:26.822699 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:26.824055 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:26.824656 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:26.824772 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:26.832983 (+ 8211us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:60521: BlockingRecv error: recv got EOF from 127.4.26.66:60521 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 12 11:11:27 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:27 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:27.307651 19776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:27.298820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:44975)
0812 11:11:27.299401 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:27.299419 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:27.299549 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:27.299869 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:27.299872 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:27.300280 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:27.300467 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:27.300477 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:27.301778 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:27.301783 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:27.302948 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:27.302964 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:27.303745 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:27.303751 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:27.303888 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:27.304484 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:27.304508 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:27.307391 (+ 2883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":344,"threads_started":1}
W20260812 11:11:27.307909 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:27.298944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:44975 (local address 127.4.26.126:40269)
0812 11:11:27.299115 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:27.299120 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:27.299507 (+ 387us) server_negotiation.cc:407] Connection header received
0812 11:11:27.299669 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:27.299673 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:27.299743 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:27.299837 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:27.300612 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:27.301639 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:27.303073 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:27.303587 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:27.303691 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:27.307656 (+ 3965us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:44975: BlockingRecv error: recv got EOF from 127.4.26.67:44975 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 12 11:11:27 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:27 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:27.366672 19777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:27.357442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:39793)
0812 11:11:27.358063 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:27.358081 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:27.358209 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:27.358532 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:27.358536 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:27.358991 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:27.359173 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:27.359183 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:27.360268 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:27.360272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:27.361369 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:27.361385 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:27.362215 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:27.362220 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:27.362358 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:27.363030 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:27.363055 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:27.366330 (+ 3275us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":270,"threads_started":1}
W20260812 11:11:27.366776 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:27.357520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:39793 (local address 127.4.26.126:40269)
0812 11:11:27.357717 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:27.357722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:27.358195 (+ 473us) server_negotiation.cc:407] Connection header received
0812 11:11:27.358303 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:27.358306 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:27.358375 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:27.358466 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:27.359319 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:27.360096 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:27.361585 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:27.362016 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:27.362117 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:27.366554 (+ 4437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:39793: BlockingRecv error: recv got EOF from 127.4.26.65:39793 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 12 11:11:27 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:27 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:27.842592 19778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:27.834008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:36517)
0812 11:11:27.834597 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:27.834614 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:27.834739 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:27.835126 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:27.835129 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:27.835596 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:27.835764 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:27.835774 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:27.836784 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:27.836787 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:27.837777 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:27.837790 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:27.838459 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:27.838463 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:27.838609 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:27.839170 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:27.839189 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:27.842281 (+ 3092us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":256,"threads_started":1}
W20260812 11:11:27.842757 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:27.834120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:36517 (local address 127.4.26.126:40269)
0812 11:11:27.834341 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:27.834349 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:27.834698 (+ 349us) server_negotiation.cc:407] Connection header received
0812 11:11:27.834910 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:27.834914 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:27.834989 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:27.835080 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:27.835878 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:27.836649 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:27.837914 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:27.838323 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:27.838420 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:27.842510 (+ 4090us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:36517: BlockingRecv error: recv got EOF from 127.4.26.66:36517 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 12 11:11:28 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:28 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:28.318970 19779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:28.308783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:40973)
0812 11:11:28.309517 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:28.309541 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:28.309703 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:28.310219 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:28.310223 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:28.310691 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:28.310875 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:28.310885 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:28.312081 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:28.312086 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:28.313200 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:28.313223 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:28.314160 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:28.314166 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:28.314308 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:28.315009 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:28.315063 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:28.318700 (+ 3637us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":378,"threads_started":1}
W20260812 11:11:28.319161 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:28.308969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:40973 (local address 127.4.26.126:40269)
0812 11:11:28.309241 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:28.309249 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:28.309680 (+ 431us) server_negotiation.cc:407] Connection header received
0812 11:11:28.309911 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:28.309916 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:28.309996 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:28.310109 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:28.311066 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:28.311889 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:28.313391 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:28.313955 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:28.314078 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:28.318942 (+ 4864us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:40973: BlockingRecv error: recv got EOF from 127.4.26.67:40973 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 12 11:11:28 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:28 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:28.376400 19780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:28.367692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:34937)
0812 11:11:28.368316 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:28.368334 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:28.368455 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:28.368807 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:28.368811 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:28.369310 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:28.369485 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:28.369495 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:28.370506 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:28.370511 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:28.371519 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:28.371531 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:28.372215 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:28.372220 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:28.372337 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:28.372926 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:28.372945 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:28.376040 (+ 3095us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":304,"threads_started":1}
W20260812 11:11:28.376556 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:28.367886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:34937 (local address 127.4.26.126:40269)
0812 11:11:28.368122 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:28.368129 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:28.368410 (+ 281us) server_negotiation.cc:407] Connection header received
0812 11:11:28.368566 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:28.368578 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:28.368677 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:28.368761 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:28.369605 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:28.370354 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:28.371634 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:28.372043 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:28.372130 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:28.376290 (+ 4160us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:34937: BlockingRecv error: recv got EOF from 127.4.26.65:34937 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 12 11:11:28 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:28 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:28.852571 19781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:28.843775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:42199)
0812 11:11:28.844374 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:28.844392 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:28.844557 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:28.844952 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:28.844957 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:28.845426 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:28.845603 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:28.845613 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:28.846823 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:28.846827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:28.847756 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:28.847769 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:28.848548 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:28.848555 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:28.848707 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:28.849378 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:28.849396 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:28.852243 (+ 2847us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":301,"threads_started":1}
W20260812 11:11:28.852782 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:28.843894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:42199 (local address 127.4.26.126:40269)
0812 11:11:28.844080 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:28.844086 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:28.844515 (+ 429us) server_negotiation.cc:407] Connection header received
0812 11:11:28.844718 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:28.844723 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:28.844792 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:28.844880 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:28.845766 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:28.846658 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:28.847911 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:28.848356 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:28.848473 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:28.852524 (+ 4051us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:42199: BlockingRecv error: recv got EOF from 127.4.26.66:42199 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 12 11:11:29 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:29 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:29.328685 19782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:29.319986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:38405)
0812 11:11:29.320528 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:29.320544 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:29.320694 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:29.321032 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:29.321037 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:29.321470 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:29.321639 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:29.321680 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:29.322770 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:29.322775 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:29.323705 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:29.323718 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:29.324500 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:29.324508 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:29.324670 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:29.325364 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:29.325382 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:29.328335 (+ 2953us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":294,"threads_started":1}
W20260812 11:11:29.328886 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:29.320088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:38405 (local address 127.4.26.126:40269)
0812 11:11:29.320292 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:29.320298 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:29.320632 (+ 334us) server_negotiation.cc:407] Connection header received
0812 11:11:29.320823 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:29.320828 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:29.320893 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:29.320976 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:29.321826 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:29.322585 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:29.323853 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:29.324299 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:29.324414 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:29.328612 (+ 4198us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:38405: BlockingRecv error: recv got EOF from 127.4.26.67:38405 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 11:11:29 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:29 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:29.386143 19784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:29.377501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:58037)
0812 11:11:29.378041 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:29.378058 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:29.378187 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:29.378531 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:29.378536 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:29.379002 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:29.379197 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:29.379208 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:29.380361 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:29.380365 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:29.381392 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:29.381405 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:29.382133 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:29.382141 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:29.382315 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:29.382888 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:29.382907 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:29.385900 (+ 2993us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":296,"threads_started":1}
W20260812 11:11:29.386327 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:29.377607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:58037 (local address 127.4.26.126:40269)
0812 11:11:29.377794 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:29.377799 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:29.378134 (+ 335us) server_negotiation.cc:407] Connection header received
0812 11:11:29.378304 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:29.378308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:29.378375 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:29.378463 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:29.379349 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:29.380222 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:29.381534 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:29.381972 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:29.382127 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:29.386109 (+ 3982us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:58037: BlockingRecv error: recv got EOF from 127.4.26.65:58037 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 12 11:11:29 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:29 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:29.863588 19787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:29.853976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:49259)
0812 11:11:29.854569 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:29.854591 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:29.854748 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:29.855092 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:29.855096 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:29.855633 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:29.855876 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:29.855890 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:29.856996 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:29.857001 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:29.858113 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:29.858129 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:29.858980 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:29.858986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:29.859162 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:29.859860 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:29.859891 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:29.863266 (+ 3375us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":399,"threads_started":1}
W20260812 11:11:29.863806 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:29.854156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:49259 (local address 127.4.26.126:40269)
0812 11:11:29.854349 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:29.854355 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:29.854691 (+ 336us) server_negotiation.cc:407] Connection header received
0812 11:11:29.854871 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:29.854875 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:29.854943 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:29.855044 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:29.856031 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:29.856828 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:29.858269 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:29.858798 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:29.858921 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:29.863553 (+ 4632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:49259: BlockingRecv error: recv got EOF from 127.4.26.66:49259 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 12 11:11:30 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:30 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:30.338696 19788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:30.329821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:39859)
0812 11:11:30.330388 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:30.330406 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:30.330538 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:30.330874 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:30.330879 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:30.331311 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:30.331484 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:30.331494 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:30.332605 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:30.332610 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:30.333651 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:30.333666 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:30.334393 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:30.334397 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:30.334529 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:30.335145 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:30.335166 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:30.338432 (+ 3266us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":304,"threads_started":1}
W20260812 11:11:30.338855 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:30.329994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:39859 (local address 127.4.26.126:40269)
0812 11:11:30.330188 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:30.330193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:30.330480 (+ 287us) server_negotiation.cc:407] Connection header received
0812 11:11:30.330653 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:30.330656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:30.330721 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:30.330817 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:30.331681 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:30.332437 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:30.333807 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:30.334260 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:30.334373 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:30.338653 (+ 4280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:39859: BlockingRecv error: recv got EOF from 127.4.26.67:39859 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 12 11:11:30 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:30 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:30.401751 19789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:30.387208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:45627)
0812 11:11:30.393776 (+ 6568us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:30.393796 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:30.393932 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:30.394259 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:30.394262 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:30.394652 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:30.394809 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:30.394818 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:30.395883 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:30.395888 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:30.396884 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:30.396899 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:30.397667 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:30.397676 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:30.397813 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:30.398452 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:30.398472 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:30.401490 (+ 3018us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":6446,"thread_start_us":6337,"threads_started":1}
W20260812 11:11:30.401958 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:30.387285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:45627 (local address 127.4.26.126:40269)
0812 11:11:30.387489 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:30.387497 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:30.393903 (+ 6406us) server_negotiation.cc:407] Connection header received
0812 11:11:30.394030 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:30.394034 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:30.394134 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:30.394226 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:30.394938 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:30.395723 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:30.396997 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:30.397484 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:30.397585 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:30.401719 (+ 4134us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:45627: BlockingRecv error: recv got EOF from 127.4.26.65:45627 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 12 11:11:30 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:30 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:30.873973 19790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:30.864742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:51631)
0812 11:11:30.865312 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:30.865328 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:30.865453 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:30.865773 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:30.865776 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:30.866202 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:30.866405 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:30.866418 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:30.867746 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:30.867751 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:30.868877 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:30.868893 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:30.869921 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:30.869926 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:30.870091 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:30.870711 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:30.870731 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:30.873707 (+ 2976us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":303,"threads_started":1}
W20260812 11:11:30.874351 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:30.864863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:51631 (local address 127.4.26.126:40269)
0812 11:11:30.865198 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:30.865206 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:30.865400 (+ 194us) server_negotiation.cc:407] Connection header received
0812 11:11:30.865549 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:30.865553 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:30.865620 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:30.865719 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:30.866557 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:30.867581 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:30.869032 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:30.869735 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:30.869848 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:30.874105 (+ 4257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:51631: BlockingRecv error: recv got EOF from 127.4.26.66:51631 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 12 11:11:31 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:31 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:31.348275 19792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:31.339696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:59329)
0812 11:11:31.340251 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:31.340269 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:31.340387 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:31.340684 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:31.340687 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:31.341064 (+ 377us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:31.341294 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:31.341307 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:31.342395 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:31.342400 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:31.343369 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:31.343384 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:31.344135 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:31.344140 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:31.344285 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:31.344966 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:31.344985 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:31.348041 (+ 3056us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":317,"threads_started":1}
W20260812 11:11:31.348636 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:31.339906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:59329 (local address 127.4.26.126:40269)
0812 11:11:31.340134 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:31.340140 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:31.340340 (+ 200us) server_negotiation.cc:407] Connection header received
0812 11:11:31.340485 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:31.340489 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:31.340552 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:31.340641 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:31.341472 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:31.342247 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:31.343535 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:31.343994 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:31.344107 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:31.348360 (+ 4253us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:59329: BlockingRecv error: recv got EOF from 127.4.26.67:59329 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 12 11:11:31 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:31 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:31.411530 19794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:31.402738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:39231)
0812 11:11:31.403299 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:31.403319 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:31.403441 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:31.403837 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:31.403842 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:31.404274 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:31.404486 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:31.404497 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:31.405562 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:31.405567 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:31.406537 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:31.406553 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:31.407388 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:31.407393 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:31.407568 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:31.408225 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:31.408244 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:31.411183 (+ 2939us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":288,"threads_started":1}
W20260812 11:11:31.411895 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:31.402818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:39231 (local address 127.4.26.126:40269)
0812 11:11:31.403053 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:31.403059 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:31.403395 (+ 336us) server_negotiation.cc:407] Connection header received
0812 11:11:31.403583 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:31.403587 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:31.403666 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:31.403753 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:31.404644 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:31.405428 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:31.406727 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:31.407224 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:31.407331 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:31.411445 (+ 4114us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:39231: BlockingRecv error: recv got EOF from 127.4.26.65:39231 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 12 11:11:31 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:31 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:31.889745 19795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:31.874984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:37901)
0812 11:11:31.875612 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:31.875630 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:31.875763 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:31.876250 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:31.876256 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:31.876820 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:31.877212 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:31.877228 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:31.878425 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:31.878431 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:31.879360 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:31.879375 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:31.880123 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:31.880130 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:31.880323 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:31.885879 (+ 5556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:31.885906 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:31.889314 (+ 3408us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":375,"threads_started":1}
W20260812 11:11:31.889889 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:31.875091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:37901 (local address 127.4.26.126:40269)
0812 11:11:31.875309 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:31.875315 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:31.875767 (+ 452us) server_negotiation.cc:407] Connection header received
0812 11:11:31.875900 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:31.875906 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:31.876064 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:31.876192 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:31.877360 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:31.878281 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:31.879512 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:31.879948 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:31.880079 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:31.889645 (+ 9566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:37901: BlockingRecv error: recv got EOF from 127.4.26.66:37901 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 12 11:11:32 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:32 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:32.358278 19796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:32.349441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:57201)
0812 11:11:32.349948 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:32.349966 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:32.350103 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:32.350403 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:32.350407 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:32.350857 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:32.351047 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:32.351057 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:32.352093 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:32.352097 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:32.353003 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:32.353015 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:32.353844 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:32.353850 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:32.354011 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:32.354657 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:32.354676 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:32.357939 (+ 3263us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":279,"threads_started":1}
W20260812 11:11:32.358451 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:32.349595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:57201 (local address 127.4.26.126:40269)
0812 11:11:32.349864 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:32.349871 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:32.350079 (+ 208us) server_negotiation.cc:407] Connection header received
0812 11:11:32.350213 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:32.350217 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:32.350284 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:32.350369 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:32.351203 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:32.351951 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:32.353217 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:32.353658 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:32.353785 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:32.358206 (+ 4421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:57201: BlockingRecv error: recv got EOF from 127.4.26.67:57201 (error 108)
Metrics: {"server-negotiator.queue_time_us":115}
Aug 12 11:11:32 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:32 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:32.420584 19797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:32.412580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:42793)
0812 11:11:32.413109 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:32.413126 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:32.413304 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:32.413613 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:32.413616 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:32.414005 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:32.414194 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:32.414203 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:32.415179 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:32.415183 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:32.416110 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:32.416121 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:32.416821 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:32.416825 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:32.416961 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:32.417603 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:32.417621 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:32.420346 (+ 2725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":293,"threads_started":1}
W20260812 11:11:32.420924 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:32.412638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:42793 (local address 127.4.26.126:40269)
0812 11:11:32.412847 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:32.412854 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:32.413243 (+ 389us) server_negotiation.cc:407] Connection header received
0812 11:11:32.413401 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:32.413405 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:32.413491 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:32.413577 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:32.414313 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:32.415029 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:32.416231 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:32.416709 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:32.416803 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:32.420626 (+ 3823us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:42793: BlockingRecv error: recv got EOF from 127.4.26.65:42793 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 12 11:11:32 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:32 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:32.899554 19798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:32.890905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:44661)
0812 11:11:32.891423 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:32.891439 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:32.891584 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:32.891931 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:32.891936 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:32.892346 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:32.892518 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:32.892528 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:32.893668 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:32.893674 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:32.894608 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:32.894622 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:32.895355 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:32.895361 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:32.895551 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:32.896146 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:32.896165 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:32.899299 (+ 3134us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":275,"threads_started":1}
W20260812 11:11:32.899801 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:32.890944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:44661 (local address 127.4.26.126:40269)
0812 11:11:32.891173 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:32.891179 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:32.891533 (+ 354us) server_negotiation.cc:407] Connection header received
0812 11:11:32.891703 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:32.891709 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:32.891775 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:32.891859 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:32.892665 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:32.893519 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:32.894759 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:32.895204 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:32.895321 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:32.899555 (+ 4234us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:44661: BlockingRecv error: recv got EOF from 127.4.26.66:44661 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 12 11:11:33 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:33 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:33.368839 19799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:33.359673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:50579)
0812 11:11:33.360282 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:33.360300 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:33.360434 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:33.360847 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:33.360851 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:33.361363 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:33.361548 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:33.361562 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:33.362892 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:33.362898 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:33.363939 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:33.363952 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:33.364725 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:33.364730 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:33.364880 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:33.365575 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:33.365596 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:33.368586 (+ 2990us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":344,"threads_started":1}
W20260812 11:11:33.369042 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:33.359768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:50579 (local address 127.4.26.126:40269)
0812 11:11:33.359958 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:33.359963 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:33.360406 (+ 443us) server_negotiation.cc:407] Connection header received
0812 11:11:33.360548 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:33.360552 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:33.360643 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:33.360742 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:33.361730 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:33.362697 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:33.364073 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:33.364562 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:33.364667 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:33.368804 (+ 4137us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:50579: BlockingRecv error: recv got EOF from 127.4.26.67:50579 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 12 11:11:33 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:33 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:33.431206 19800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:33.422000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:40075)
0812 11:11:33.422591 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:33.422609 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:33.422747 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:33.423120 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:33.423124 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:33.423579 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:33.423762 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:33.423772 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:33.425038 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:33.425044 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:33.426453 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:33.426472 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:33.427223 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:33.427227 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:33.427346 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:33.427934 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:33.427953 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:33.430954 (+ 3001us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":275,"threads_started":1}
W20260812 11:11:33.431367 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:33.422113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:40075 (local address 127.4.26.126:40269)
0812 11:11:33.422350 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:33.422357 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:33.422761 (+ 404us) server_negotiation.cc:407] Connection header received
0812 11:11:33.422843 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:33.422847 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:33.422951 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:33.423056 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:33.423929 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:33.424882 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:33.426603 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:33.427066 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:33.427171 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:33.431164 (+ 3993us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:40075: BlockingRecv error: recv got EOF from 127.4.26.65:40075 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 12 11:11:33 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:33 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:33.909911 19801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:33.900575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:53745)
0812 11:11:33.901167 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:33.901186 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:33.901313 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:33.901622 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:33.901625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:33.902125 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:33.902311 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:33.902321 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:33.903620 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:33.903625 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:33.904601 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:33.904617 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:33.905504 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:33.905510 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:33.905672 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:33.906310 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:33.906331 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:33.909572 (+ 3241us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":280,"threads_started":1}
W20260812 11:11:33.910054 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:33.900784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:53745 (local address 127.4.26.126:40269)
0812 11:11:33.901010 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:33.901014 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:33.901276 (+ 262us) server_negotiation.cc:407] Connection header received
0812 11:11:33.901416 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:33.901420 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:33.901491 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:33.901598 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:33.902498 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:33.903439 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:33.904795 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:33.905310 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:33.905424 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:33.909778 (+ 4354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:53745: BlockingRecv error: recv got EOF from 127.4.26.66:53745 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 12 11:11:34 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:34 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:34.379055 19802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:34.369804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:49219)
0812 11:11:34.370336 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:34.370353 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:34.370475 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:34.370764 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:34.370767 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:34.371163 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:34.371328 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:34.371338 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:34.372430 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:34.372434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:34.373457 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:34.373473 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:34.374261 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:34.374266 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:34.374392 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:34.375014 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:34.375034 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:34.378710 (+ 3676us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":262,"threads_started":1}
W20260812 11:11:34.379211 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:34.369838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:49219 (local address 127.4.26.126:40269)
0812 11:11:34.369997 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:34.370002 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:34.370467 (+ 465us) server_negotiation.cc:407] Connection header received
0812 11:11:34.370569 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:34.370577 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:34.370646 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:34.370733 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:34.371499 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:34.372307 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:34.373631 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:34.374072 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:34.374175 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:34.378936 (+ 4761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:49219: BlockingRecv error: recv got EOF from 127.4.26.67:49219 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 12 11:11:34 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:34 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:34.441447 19803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:34.432287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:57261)
0812 11:11:34.432792 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:34.432810 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:34.432934 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:34.433323 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:34.433327 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:34.433726 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:34.433916 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:34.433927 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:34.435190 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:34.435196 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:34.436176 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:34.436191 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:34.437043 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:34.437049 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:34.437237 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:34.437943 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:34.437963 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:34.441142 (+ 3179us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":257,"threads_started":1}
W20260812 11:11:34.441751 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:34.432396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:57261 (local address 127.4.26.126:40269)
0812 11:11:34.432779 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:34.432784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:34.432880 (+ 96us) server_negotiation.cc:407] Connection header received
0812 11:11:34.433054 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:34.433058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:34.433143 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:34.433267 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:34.434123 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:34.434985 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:34.436347 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:34.436823 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:34.436943 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:34.441456 (+ 4513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:57261: BlockingRecv error: recv got EOF from 127.4.26.65:57261 (error 108)
Metrics: {"server-negotiator.queue_time_us":248}
Aug 12 11:11:34 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:34 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:34.919641 19804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:34.911059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:50637)
0812 11:11:34.911572 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:34.911592 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:34.911758 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:34.912075 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:34.912078 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:34.912447 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:34.912659 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:34.912669 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:34.913706 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:34.913710 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:34.914759 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:34.914774 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:34.915639 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:34.915646 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:34.915828 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:34.916520 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:34.916539 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:34.919405 (+ 2866us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":294,"threads_started":1}
W20260812 11:11:34.919875 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:34.911290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:50637 (local address 127.4.26.126:40269)
0812 11:11:34.911471 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:34.911476 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:34.911703 (+ 227us) server_negotiation.cc:407] Connection header received
0812 11:11:34.911864 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:34.911868 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:34.911937 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:34.912035 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:34.912790 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:34.913561 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:34.914921 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:34.915468 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:34.915590 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:34.919652 (+ 4062us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:50637: BlockingRecv error: recv got EOF from 127.4.26.66:50637 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 12 11:11:35 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:35 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.67@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:35.388820 19805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:35.380336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.67:60307)
0812 11:11:35.380869 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:35.380903 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:35.381043 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:35.381419 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:35.381424 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:35.381867 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:35.382050 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:35.382060 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:35.383099 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:35.383104 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:35.384041 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:35.384056 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:35.384845 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:35.384851 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:35.385007 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:35.385707 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:35.385726 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:35.388531 (+ 2805us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":260,"threads_started":1}
W20260812 11:11:35.389007 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:35.380528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:60307 (local address 127.4.26.126:40269)
0812 11:11:35.380776 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:35.380782 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:35.380988 (+ 206us) server_negotiation.cc:407] Connection header received
0812 11:11:35.381207 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:35.381211 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:35.381277 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:35.381380 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:35.382228 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:35.382940 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:35.384217 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:35.384687 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:35.384799 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:35.388786 (+ 3987us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.67:60307: BlockingRecv error: recv got EOF from 127.4.26.67:60307 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 12 11:11:35 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:35 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.65@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:35.451757 19806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:35.442773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.65:51889)
0812 11:11:35.443349 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:35.443369 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:35.443517 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:35.443893 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:35.443898 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:35.444345 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:35.444566 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:35.444576 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:35.445696 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:35.445701 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:35.446730 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:35.446748 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:35.447770 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:35.447775 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:35.447912 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:35.448607 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:35.448629 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:35.451456 (+ 2827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":307,"threads_started":1}
W20260812 11:11:35.451879 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:35.442896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:51889 (local address 127.4.26.126:40269)
0812 11:11:35.443186 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:35.443193 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:35.443469 (+ 276us) server_negotiation.cc:407] Connection header received
0812 11:11:35.443640 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:35.443645 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:35.443743 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:35.443838 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:35.444744 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:35.445540 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:35.446927 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:35.447609 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:35.447744 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:35.451680 (+ 3936us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.65:51889: BlockingRecv error: recv got EOF from 127.4.26.65:51889 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
Aug 12 11:11:35 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
Aug 12 11:11:35 dist-test-slave-rmhg krb5kdc[18080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.26.66@KRBTEST.COM for oryx/127.4.26.126@KRBTEST.COM, Server not found in Kerberos database
I20260812 11:11:35.929679 19807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:35.920869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:40269 (local address 127.4.26.66:37763)
0812 11:11:35.921469 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:35.921486 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:35.921606 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:35.921903 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:35.921906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:35.922320 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:35.922565 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:35.922577 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:35.923616 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:35.923620 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:35.924637 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:35.924652 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:35.925567 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:35.925572 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:35.925705 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:35.926441 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:35.926460 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:35.929395 (+ 2935us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.26.126:40269: Server oryx/127.4.26.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":334,"threads_started":1}
W20260812 11:11:35.929996 19317 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:35.921012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:37763 (local address 127.4.26.126:40269)
0812 11:11:35.921245 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:35.921250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:35.921560 (+ 310us) server_negotiation.cc:407] Connection header received
0812 11:11:35.921714 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:35.921718 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:35.921783 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:35.921871 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:35.922710 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:35.923453 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:35.924803 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:35.925382 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:35.925496 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:35.929674 (+ 4178us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.26.66:37763: BlockingRecv error: recv got EOF from 127.4.26.66:37763 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 11:11:36.220753 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 19082
I20260812 11:11:36.234376 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:36.221963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33656 (local address 127.4.26.65:46547)
0812 11:11:36.222510 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:36.222517 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:36.222549 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:11:36.222614 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:36.222620 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:36.222864 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:36.223039 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:36.224615 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:36.225757 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:36.227193 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:36.227828 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:36.227939 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:36.230870 (+ 2931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:36.230881 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:36.230899 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:36.230941 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:36.233833 (+ 2892us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.4.26.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 11:11:36.234145 (+ 312us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33656: Request ticket server kudu/127.4.26.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":248,"threads_started":1}
W20260812 11:11:36.234474 19810 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33656: Request ticket server kudu/127.4.26.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 11:11:36.234730 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 19082: Not authorized: Client connection negotiation failed: client connection to 127.4.26.65:46547: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.4.26.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 11:11:36.235024 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 19082
I20260812 11:11:36.260516 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 19320
I20260812 11:11:36.274081 19811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:36.261716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44984 (local address 127.4.26.66:43347)
0812 11:11:36.262328 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:36.262336 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:36.262368 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:11:36.262429 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:36.262436 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:36.262660 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:36.262826 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:36.264206 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:36.265629 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:36.267041 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:36.267682 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:36.267809 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:36.270662 (+ 2853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:36.270672 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:36.270689 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:36.270733 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:36.273500 (+ 2767us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.4.26.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 11:11:36.273830 (+ 330us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44984: Request ticket server kudu/127.4.26.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":288,"threads_started":1}
W20260812 11:11:36.274210 19811 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44984: Request ticket server kudu/127.4.26.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 11:11:36.274277 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 19320: Not authorized: Client connection negotiation failed: client connection to 127.4.26.66:43347: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.4.26.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 11:11:36.274431 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 19320
I20260812 11:11:36.299578 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 19525
I20260812 11:11:36.313362 19814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:36.300595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48476 (local address 127.4.26.67:45993)
0812 11:11:36.301298 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:36.301305 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:36.301334 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:11:36.301396 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:36.301404 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:36.301669 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:36.301837 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:36.303403 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:36.304639 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:36.306153 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:36.306799 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:36.306917 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:36.309868 (+ 2951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:36.309880 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:36.309900 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:36.309948 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:36.312760 (+ 2812us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.4.26.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0812 11:11:36.313063 (+ 303us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48476: Request ticket server kudu/127.4.26.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":360,"threads_started":1}
W20260812 11:11:36.313464 19814 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48476: Request ticket server kudu/127.4.26.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260812 11:11:36.313700 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 19525: Not authorized: Client connection negotiation failed: client connection to 127.4.26.67:45993: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.4.26.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260812 11:11:36.313854 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 19525
I20260812 11:11:36.336702 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 18974
I20260812 11:11:36.338135 19070 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:36.457363 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 18974
2026-08-12T11:11:36Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21681 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-12T11:11:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:11:36Z Disabled control of system clock
I20260812 11:11:36.550628 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:35851
--webserver_interface=127.4.26.126
--webserver_port=0
--builtin_ntp_servers=127.4.26.84:40951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:35851
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260812 11:11:36.897606 19820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:36.897918 19820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:36.898000 19820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:36.905545 19820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:11:36.905680 19820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:36.905717 19820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:36.905776 19820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:11:36.905821 19820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:11:36.915289 19820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:35851
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:35851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:36.916635 19820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:36.918517 19820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:36.931157 19832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:36.931182 19828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:36.931159 19829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:36.931926 19820 server_base.cc:1034] running on GCE node
I20260812 11:11:36.932806 19820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:36.934423 19820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:36.935639 19820 hybrid_clock.cc:648] HybridClock initialized: now 1786533096935580 us; error 51 us; skew 500 ppm
I20260812 11:11:36.936021 19820 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:11:36.943397 19820 webserver.cc:460] Webserver started at http://127.4.26.126:38965/ using document root <none> and password file <none>
I20260812 11:11:36.944213 19820 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:36.944316 19820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:36.944684 19820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:36.947876 19820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "e8a4775053fa4156b12bc38e153e8121"
format_stamp: "Formatted at 2026-08-12 11:11:36 on dist-test-slave-rmhg"
server_key: "ddcfbbc73176921f5448d17a9ad0c86a"
server_key_iv: "a5a6d714a6d160a1fe265634c74bf457"
server_key_version: "encryptionkey@0"
I20260812 11:11:36.948683 19820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "e8a4775053fa4156b12bc38e153e8121"
format_stamp: "Formatted at 2026-08-12 11:11:36 on dist-test-slave-rmhg"
server_key: "ddcfbbc73176921f5448d17a9ad0c86a"
server_key_iv: "a5a6d714a6d160a1fe265634c74bf457"
server_key_version: "encryptionkey@0"
I20260812 11:11:36.954223 19820 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 11:11:36.958150 19842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:36.959765 19820 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:11:36.959957 19820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "e8a4775053fa4156b12bc38e153e8121"
format_stamp: "Formatted at 2026-08-12 11:11:36 on dist-test-slave-rmhg"
server_key: "ddcfbbc73176921f5448d17a9ad0c86a"
server_key_iv: "a5a6d714a6d160a1fe265634c74bf457"
server_key_version: "encryptionkey@0"
I20260812 11:11:36.960202 19820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:36.975176 19820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:36.976145 19820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:36.976451 19820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:36.994966 19820 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:35851
I20260812 11:11:36.994993 19922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:35851 every 8 connection(s)
I20260812 11:11:36.996404 19820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:11:36.998332 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 19820
I20260812 11:11:36.998544 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:11:36.999466 4201 external_mini_cluster.cc:1428] Setting key f7e591ed1b5cb8357e62fb50b0fae240
I20260812 11:11:37.001657 19923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:37.014367 19928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:37.001885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43284 (local address 127.4.26.126:35851)
0812 11:11:37.003054 (+ 1169us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:37.003066 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:37.003111 (+ 45us) server_negotiation.cc:407] Connection header received
0812 11:11:37.004757 (+ 1646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:37.004785 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:37.005397 (+ 612us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:37.005846 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:37.006601 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:37.008015 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:37.009571 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:37.010265 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:37.010463 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:37.011865 (+ 1402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:37.011873 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:37.011890 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:11:37.012523 (+ 633us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:37.012606 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:11:37.012628 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:37.012772 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:37.012994 (+ 222us) server_negotiation.cc:299] Negotiation successful
0812 11:11:37.013363 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":713,"thread_start_us":389,"threads_started":1}
I20260812 11:11:37.014494 19923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121: Bootstrap starting.
I20260812 11:11:37.018006 19923 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:37.019121 19923 log.cc:824] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121: Log is configured to *not* fsync() on all Append() calls
I20260812 11:11:37.022284 19923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121: No bootstrap required, opened a new log
I20260812 11:11:37.030303 19923 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8a4775053fa4156b12bc38e153e8121" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35851 } }
I20260812 11:11:37.030867 19923 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:37.030987 19923 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8a4775053fa4156b12bc38e153e8121, State: Initialized, Role: FOLLOWER
I20260812 11:11:37.031628 19923 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8a4775053fa4156b12bc38e153e8121" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35851 } }
I20260812 11:11:37.031860 19923 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:11:37.031997 19923 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:11:37.032181 19923 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:37.034523 19923 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8a4775053fa4156b12bc38e153e8121" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35851 } }
I20260812 11:11:37.035153 19923 leader_election.cc:302] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8a4775053fa4156b12bc38e153e8121; no voters:
I20260812 11:11:37.035941 19923 leader_election.cc:288] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:11:37.036128 19931 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:11:37.036896 19931 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [term 1 LEADER]: Becoming Leader. State: Replica: e8a4775053fa4156b12bc38e153e8121, State: Running, Role: LEADER
I20260812 11:11:37.037571 19931 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8a4775053fa4156b12bc38e153e8121" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35851 } }
I20260812 11:11:37.038309 19923 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:11:37.040477 19935 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8a4775053fa4156b12bc38e153e8121. Latest consensus state: current_term: 1 leader_uuid: "e8a4775053fa4156b12bc38e153e8121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8a4775053fa4156b12bc38e153e8121" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35851 } } }
I20260812 11:11:37.040547 19932 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8a4775053fa4156b12bc38e153e8121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8a4775053fa4156b12bc38e153e8121" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35851 } } }
I20260812 11:11:37.040807 19935 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [sys.catalog]: This master's current role is: LEADER
I20260812 11:11:37.040922 19932 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121 [sys.catalog]: This master's current role is: LEADER
I20260812 11:11:37.042727 19941 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:11:37.048306 19941 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:11:37.057950 19941 catalog_manager.cc:1347] Generated new cluster ID: 4bc72eef22e94de2bd00a25c9e9dc6a3
I20260812 11:11:37.058089 19941 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:11:37.086472 19941 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:11:37.087838 19941 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:11:37.097301 19941 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e8a4775053fa4156b12bc38e153e8121: Generated new TSK 0
I20260812 11:11:37.098273 19941 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:11:37.107755 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:35851
--builtin_ntp_servers=127.4.26.84:40951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260812 11:11:37.484719 19962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:37.485030 19962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:37.485136 19962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:37.492676 19962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:37.492801 19962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:37.492959 19962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:11:37.502533 19962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:35851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:37.503988 19962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:37.505919 19962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:37.519435 19972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:37.519582 19970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:37.519994 19969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:37.520032 19962 server_base.cc:1034] running on GCE node
I20260812 11:11:37.520951 19962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:37.522056 19962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:37.523293 19962 hybrid_clock.cc:648] HybridClock initialized: now 1786533097523232 us; error 46 us; skew 500 ppm
I20260812 11:11:37.523643 19962 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:11:37.526120 19962 webserver.cc:460] Webserver started at http://127.4.26.65:35791/ using document root <none> and password file <none>
I20260812 11:11:37.526844 19962 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:37.526978 19962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:37.527307 19962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:37.530421 19962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "75c6388454134cf28c3a7a3f0913d1da"
format_stamp: "Formatted at 2026-08-12 11:11:37 on dist-test-slave-rmhg"
server_key: "e1843f84218fa627fc4b8650a7309872"
server_key_iv: "188ce0bb919a4a2f08ead419950c3267"
server_key_version: "encryptionkey@0"
I20260812 11:11:37.531256 19962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "75c6388454134cf28c3a7a3f0913d1da"
format_stamp: "Formatted at 2026-08-12 11:11:37 on dist-test-slave-rmhg"
server_key: "e1843f84218fa627fc4b8650a7309872"
server_key_iv: "188ce0bb919a4a2f08ead419950c3267"
server_key_version: "encryptionkey@0"
I20260812 11:11:37.536871 19962 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:11:37.541292 19980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:37.542992 19962 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:11:37.543190 19962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "75c6388454134cf28c3a7a3f0913d1da"
format_stamp: "Formatted at 2026-08-12 11:11:37 on dist-test-slave-rmhg"
server_key: "e1843f84218fa627fc4b8650a7309872"
server_key_iv: "188ce0bb919a4a2f08ead419950c3267"
server_key_version: "encryptionkey@0"
I20260812 11:11:37.543429 19962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:37.559772 19962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:37.560801 19962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:37.561182 19962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:37.562522 19962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:11:37.564590 19962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:37.564700 19962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:37.564795 19962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:37.564850 19962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:37.597754 19962 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:35811
I20260812 11:11:37.597791 20182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:35811 every 8 connection(s)
I20260812 11:11:37.599244 19962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:11:37.599886 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 19962
I20260812 11:11:37.600101 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:11:37.600941 4201 external_mini_cluster.cc:1428] Setting key cbae15ae0ba58c0dd661ac7a8d1ab258
I20260812 11:11:37.604112 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:35851
--builtin_ntp_servers=127.4.26.84:40951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 11:11:37.613798 20188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:37.602586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:39995 (local address 127.4.26.126:35851)
0812 11:11:37.603080 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:37.603087 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:37.604623 (+ 1536us) server_negotiation.cc:407] Connection header received
0812 11:11:37.606519 (+ 1896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:37.606525 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:37.606610 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:37.606731 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:37.607981 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:37.608937 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:37.610804 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:37.611255 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:37.611389 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:37.612862 (+ 1473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:37.612867 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:37.612870 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:11:37.612891 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:37.612940 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:11:37.612954 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:37.613031 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:37.613319 (+ 288us) server_negotiation.cc:299] Negotiation successful
0812 11:11:37.613428 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":236,"threads_started":1}
I20260812 11:11:37.614905 20191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:37.603270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:35851 (local address 127.4.26.65:39995)
0812 11:11:37.604422 (+ 1152us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:37.604494 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:37.606215 (+ 1721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:37.607010 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:37.607020 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:37.607128 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:37.607788 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:37.607808 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:37.609136 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:37.609141 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:37.610623 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:37.610639 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:37.611537 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:37.611545 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:37.611810 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:37.612520 (+ 710us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:11:37.612523 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:37.612568 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:11:37.612658 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:37.613047 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:37.613061 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:37.613068 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 11:11:37.613282 (+ 214us) client_negotiation.cc:240] Negotiation successful
0812 11:11:37.613756 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":376,"threads_started":1}
I20260812 11:11:37.616536 20184 heartbeater.cc:347] Connected to a master server at 127.4.26.126:35851
I20260812 11:11:37.616916 20184 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:37.617911 20184 heartbeater.cc:511] Master 127.4.26.126:35851 requested a full tablet report, sending...
I20260812 11:11:37.620230 19869 ts_manager.cc:194] Registered new tserver with Master: 75c6388454134cf28c3a7a3f0913d1da (127.4.26.65:35811)
I20260812 11:11:37.621847 19869 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.26.65:39995
W20260812 11:11:37.955731 20192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:37.956044 20192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:37.956152 20192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:37.963728 20192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:37.963865 20192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:37.964004 20192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:11:37.973789 20192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:35851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:37.975159 20192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:37.977088 20192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:37.991161 20203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:37.991163 20202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:37.991268 20205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:37.991786 20192 server_base.cc:1034] running on GCE node
I20260812 11:11:37.992578 20192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:37.993638 20192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:37.994860 20192 hybrid_clock.cc:648] HybridClock initialized: now 1786533097994792 us; error 57 us; skew 500 ppm
I20260812 11:11:37.995270 20192 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:11:37.998221 20192 webserver.cc:460] Webserver started at http://127.4.26.66:38113/ using document root <none> and password file <none>
I20260812 11:11:37.999119 20192 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:37.999248 20192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:37.999609 20192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:38.003738 20192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "7e1f8d3238d44786bec21cff47e5737e"
format_stamp: "Formatted at 2026-08-12 11:11:37 on dist-test-slave-rmhg"
server_key: "4139378e31f74119e8bad371a70f1bf0"
server_key_iv: "abdbf7f15c832754fadf77dbc1f5a797"
server_key_version: "encryptionkey@0"
I20260812 11:11:38.004820 20192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "7e1f8d3238d44786bec21cff47e5737e"
format_stamp: "Formatted at 2026-08-12 11:11:37 on dist-test-slave-rmhg"
server_key: "4139378e31f74119e8bad371a70f1bf0"
server_key_iv: "abdbf7f15c832754fadf77dbc1f5a797"
server_key_version: "encryptionkey@0"
I20260812 11:11:38.011981 20192 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.004s
I20260812 11:11:38.016700 20213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:38.018316 20192 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 11:11:38.018483 20192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "7e1f8d3238d44786bec21cff47e5737e"
format_stamp: "Formatted at 2026-08-12 11:11:37 on dist-test-slave-rmhg"
server_key: "4139378e31f74119e8bad371a70f1bf0"
server_key_iv: "abdbf7f15c832754fadf77dbc1f5a797"
server_key_version: "encryptionkey@0"
I20260812 11:11:38.018698 20192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:38.035528 20192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:38.036389 20192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:38.036639 20192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:38.037760 20192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:11:38.039486 20192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:38.039600 20192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:38.039721 20192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:38.039801 20192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:38.070572 20192 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:43765
I20260812 11:11:38.070629 20388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:43765 every 8 connection(s)
I20260812 11:11:38.071907 20192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:11:38.074786 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 20192
I20260812 11:11:38.074956 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:11:38.075433 4201 external_mini_cluster.cc:1428] Setting key 6b131da41bdd6b33c290f95b8d2531da
I20260812 11:11:38.078732 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:35851
--builtin_ntp_servers=127.4.26.84:40951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260812 11:11:38.086421 20188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:38.074798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:38933 (local address 127.4.26.126:35851)
0812 11:11:38.075019 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:38.075026 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:38.077000 (+ 1974us) server_negotiation.cc:407] Connection header received
0812 11:11:38.079093 (+ 2093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:38.079099 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:38.079185 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:38.079292 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:38.080522 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:38.081555 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:38.083287 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:38.083844 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:38.083974 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:38.085569 (+ 1595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:38.085576 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:38.085580 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:11:38.085605 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:38.085657 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:11:38.085673 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:38.085760 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:38.085977 (+ 217us) server_negotiation.cc:299] Negotiation successful
0812 11:11:38.086089 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 11:11:38.087538 20393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:38.075287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:35851 (local address 127.4.26.66:38933)
0812 11:11:38.076779 (+ 1492us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:38.076854 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:38.078775 (+ 1921us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:38.079563 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:38.079572 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:38.079675 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:38.080303 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:38.080352 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:38.081728 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:38.081732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:38.083124 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:38.083138 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:38.084111 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:38.084118 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:38.084367 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:38.085203 (+ 836us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:11:38.085207 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:38.085258 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:11:38.085354 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:38.085773 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:38.085782 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:38.085788 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:11:38.085948 (+ 160us) client_negotiation.cc:240] Negotiation successful
0812 11:11:38.086311 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":905,"thread_start_us":696,"threads_started":1}
I20260812 11:11:38.089389 20389 heartbeater.cc:347] Connected to a master server at 127.4.26.126:35851
I20260812 11:11:38.089764 20389 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:38.090704 20389 heartbeater.cc:511] Master 127.4.26.126:35851 requested a full tablet report, sending...
I20260812 11:11:38.092579 19869 ts_manager.cc:194] Registered new tserver with Master: 7e1f8d3238d44786bec21cff47e5737e (127.4.26.66:43765)
I20260812 11:11:38.093750 19869 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.26.66:38933
W20260812 11:11:38.428004 20398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:38.428294 20398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:38.428380 20398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:38.435796 20398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:38.435927 20398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:38.436034 20398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:11:38.446102 20398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:35851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:38.447532 20398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:38.449494 20398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:38.463122 20409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:38.463147 20406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:38.463178 20405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:38.464251 20398 server_base.cc:1034] running on GCE node
I20260812 11:11:38.464911 20398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:38.465991 20398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:38.467207 20398 hybrid_clock.cc:648] HybridClock initialized: now 1786533098467154 us; error 51 us; skew 500 ppm
I20260812 11:11:38.467541 20398 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:11:38.469959 20398 webserver.cc:460] Webserver started at http://127.4.26.67:35067/ using document root <none> and password file <none>
I20260812 11:11:38.470682 20398 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:38.470790 20398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:38.471117 20398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:38.474146 20398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "6c567894f6b449949769c683fe0721dc"
format_stamp: "Formatted at 2026-08-12 11:11:38 on dist-test-slave-rmhg"
server_key: "cdf0c928ab3d4e12fd5cb7e863e2684d"
server_key_iv: "3e60de438e19bcb81599a13fcccd8057"
server_key_version: "encryptionkey@0"
I20260812 11:11:38.474982 20398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "6c567894f6b449949769c683fe0721dc"
format_stamp: "Formatted at 2026-08-12 11:11:38 on dist-test-slave-rmhg"
server_key: "cdf0c928ab3d4e12fd5cb7e863e2684d"
server_key_iv: "3e60de438e19bcb81599a13fcccd8057"
server_key_version: "encryptionkey@0"
I20260812 11:11:38.480458 20398 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:11:38.484198 20419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:38.485827 20398 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 11:11:38.486006 20398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "6c567894f6b449949769c683fe0721dc"
format_stamp: "Formatted at 2026-08-12 11:11:38 on dist-test-slave-rmhg"
server_key: "cdf0c928ab3d4e12fd5cb7e863e2684d"
server_key_iv: "3e60de438e19bcb81599a13fcccd8057"
server_key_version: "encryptionkey@0"
I20260812 11:11:38.486240 20398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:38.509862 20398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:38.510802 20398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:38.511106 20398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:38.512143 20398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:11:38.513770 20398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:38.513871 20398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:38.513986 20398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:38.514056 20398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:38.546602 20398 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:42345
I20260812 11:11:38.546685 20601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:42345 every 8 connection(s)
I20260812 11:11:38.548013 20398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:11:38.549342 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 20398
I20260812 11:11:38.549532 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:11:38.550120 4201 external_mini_cluster.cc:1428] Setting key e7dae30281176438d7769dc249c84267
I20260812 11:11:38.562292 20188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:38.551269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:33689 (local address 127.4.26.126:35851)
0812 11:11:38.551446 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:38.551451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:38.553295 (+ 1844us) server_negotiation.cc:407] Connection header received
0812 11:11:38.555232 (+ 1937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:38.555237 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:38.555311 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:38.555398 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:38.556561 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:38.557398 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:38.559097 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:38.559525 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:38.559625 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:38.561140 (+ 1515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:38.561145 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:38.561185 (+ 40us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:11:38.561215 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:38.561255 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:11:38.561269 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:38.561350 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:38.561919 (+ 569us) server_negotiation.cc:299] Negotiation successful
0812 11:11:38.562028 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 11:11:38.563642 20606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:38.551855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:35851 (local address 127.4.26.67:33689)
0812 11:11:38.553102 (+ 1247us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:38.553188 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:38.554936 (+ 1748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:38.555615 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:38.555623 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:38.555721 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:38.556388 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:38.556406 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:38.557582 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:38.557586 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:38.558920 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:38.558934 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:38.559774 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:38.559781 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:38.560044 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:38.560732 (+ 688us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:11:38.560735 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:38.560783 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:11:38.560881 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:38.561504 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:38.561516 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:38.561524 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 11:11:38.561737 (+ 213us) client_negotiation.cc:240] Negotiation successful
0812 11:11:38.562297 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":373,"threads_started":1}
I20260812 11:11:38.565595 20602 heartbeater.cc:347] Connected to a master server at 127.4.26.126:35851
I20260812 11:11:38.565986 20602 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:38.567082 20602 heartbeater.cc:511] Master 127.4.26.126:35851 requested a full tablet report, sending...
I20260812 11:11:38.568886 19869 ts_manager.cc:194] Registered new tserver with Master: 6c567894f6b449949769c683fe0721dc (127.4.26.67:42345)
I20260812 11:11:38.569742 19869 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.26.67:33689
I20260812 11:11:38.580235 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 11:11:38.587123 20188 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:38.585409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43298 (local address 127.4.26.126:35851)
0812 11:11:38.585741 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:38.585749 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:38.586071 (+ 322us) server_negotiation.cc:407] Connection header received
0812 11:11:38.586261 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:38.586266 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:38.586347 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:38.586441 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:38.586921 (+ 480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43298: BlockingRecv error: recv got EOF from 127.0.0.1:43298 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 11:11:38.587997 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 19962
I20260812 11:11:38.596171 20614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:38.588961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34996 (local address 127.4.26.65:35811)
0812 11:11:38.589550 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:38.589557 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:38.589588 (+ 31us) server_negotiation.cc:407] Connection header received
0812 11:11:38.589661 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:38.589668 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:38.589895 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:38.590053 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:38.590458 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:38.591566 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:38.592906 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:38.593602 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:38.593700 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:38.594729 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:38.594738 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:38.594754 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:11:38.595391 (+ 637us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:38.595442 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:11:38.595469 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:38.595611 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:38.595715 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 11:11:38.595864 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":287,"threads_started":1}
I20260812 11:11:38.597723 20175 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:38.680394 20184 heartbeater.cc:503] Master 127.4.26.126:35851 was elected leader, sending a full tablet report...
I20260812 11:11:38.681493 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 19962
W20260812 11:11:38.700624 19843 connection.cc:535] server connection from 127.4.26.65:39995 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 11:11:38.700860 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 20192
I20260812 11:11:38.709630 20616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:38.701936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36374 (local address 127.4.26.66:43765)
0812 11:11:38.702482 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:38.702490 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:38.702519 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:11:38.702588 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:38.702595 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:38.702814 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:38.702950 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:38.703255 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:38.704302 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:38.705784 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:38.706670 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:38.706806 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:38.707929 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:38.707939 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:38.707956 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:11:38.708609 (+ 653us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:38.708674 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:11:38.708696 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:38.708808 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:38.708984 (+ 176us) server_negotiation.cc:299] Negotiation successful
0812 11:11:38.709312 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":274,"threads_started":1}
I20260812 11:11:38.711088 20384 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:38.793967 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 20192
I20260812 11:11:38.817905 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 20398
I20260812 11:11:38.827035 20618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:38.818932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44664 (local address 127.4.26.67:42345)
0812 11:11:38.819650 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:38.819658 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:38.819692 (+ 34us) server_negotiation.cc:407] Connection header received
0812 11:11:38.819758 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:38.819765 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:38.820030 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:38.820175 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:38.820625 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:38.821840 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:38.823318 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:38.823986 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:38.824103 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:38.825482 (+ 1379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:38.825492 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:38.825511 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:11:38.826154 (+ 643us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:38.826208 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:11:38.826230 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:38.826326 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:38.826504 (+ 178us) server_negotiation.cc:299] Negotiation successful
0812 11:11:38.826634 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550,"thread_start_us":370,"threads_started":1}
I20260812 11:11:38.828449 20594 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:38.910941 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 20398
I20260812 11:11:38.932891 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 19820
I20260812 11:11:38.934238 19917 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:39.037451 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 19820
2026-08-12T11:11:39Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2578 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-12T11:11:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:11:39Z Disabled control of system clock
I20260812 11:11:39.128109 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37141
--webserver_interface=127.4.26.126
--webserver_port=0
--builtin_ntp_servers=127.4.26.84:40329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:37141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 11:11:39.479256 20629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:39.479592 20629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:39.479681 20629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:39.487566 20629 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:11:39.487694 20629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:39.487739 20629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:39.487797 20629 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:11:39.487845 20629 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:11:39.497566 20629 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:37141
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:39.498881 20629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:39.500736 20629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:39.512991 20638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:39.513063 20639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:39.513023 20644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:39.513914 20629 server_base.cc:1034] running on GCE node
I20260812 11:11:39.514810 20629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:39.516358 20629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:39.517589 20629 hybrid_clock.cc:648] HybridClock initialized: now 1786533099517519 us; error 72 us; skew 500 ppm
I20260812 11:11:39.517999 20629 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:11:39.520376 20629 webserver.cc:460] Webserver started at http://127.4.26.126:45091/ using document root <none> and password file <none>
I20260812 11:11:39.521121 20629 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:39.521281 20629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:39.521613 20629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:39.524726 20629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "1e3d2f7dc51d452887206a627d5c2ad8"
format_stamp: "Formatted at 2026-08-12 11:11:39 on dist-test-slave-rmhg"
server_key: "6c22b24f98dd5178f5d78aad01c8a74f"
server_key_iv: "50a35e2567696f740e01fbcabe4e06d6"
server_key_version: "encryptionkey@0"
I20260812 11:11:39.525588 20629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "1e3d2f7dc51d452887206a627d5c2ad8"
format_stamp: "Formatted at 2026-08-12 11:11:39 on dist-test-slave-rmhg"
server_key: "6c22b24f98dd5178f5d78aad01c8a74f"
server_key_iv: "50a35e2567696f740e01fbcabe4e06d6"
server_key_version: "encryptionkey@0"
I20260812 11:11:39.531008 20629 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 11:11:39.534706 20655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:39.536260 20629 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260812 11:11:39.536449 20629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "1e3d2f7dc51d452887206a627d5c2ad8"
format_stamp: "Formatted at 2026-08-12 11:11:39 on dist-test-slave-rmhg"
server_key: "6c22b24f98dd5178f5d78aad01c8a74f"
server_key_iv: "50a35e2567696f740e01fbcabe4e06d6"
server_key_version: "encryptionkey@0"
I20260812 11:11:39.536679 20629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:39.542851 20629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:39.543689 20629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:39.543988 20629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:39.561990 20629 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:37141
I20260812 11:11:39.562002 20731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:37141 every 8 connection(s)
I20260812 11:11:39.563449 20629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:11:39.565724 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 20629
I20260812 11:11:39.565961 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:11:39.566771 4201 external_mini_cluster.cc:1428] Setting key 46089865b2f77b52dffda0872be28d65
I20260812 11:11:39.568250 20734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:39.577814 20740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:39.569309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34432 (local address 127.4.26.126:37141)
0812 11:11:39.570783 (+ 1474us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:39.570799 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:39.570852 (+ 53us) server_negotiation.cc:407] Connection header received
0812 11:11:39.573305 (+ 2453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:39.573338 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:39.573962 (+ 624us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:39.574465 (+ 503us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:39.575575 (+ 1110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:39.575584 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:39.575602 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:11:39.575620 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:39.575704 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:11:39.575727 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:39.575972 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:39.576118 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 11:11:39.576455 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":937,"thread_start_us":632,"threads_started":1}
I20260812 11:11:39.583244 20734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8: Bootstrap starting.
I20260812 11:11:39.586874 20734 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:39.588383 20734 log.cc:824] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8: Log is configured to *not* fsync() on all Append() calls
I20260812 11:11:39.591883 20734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8: No bootstrap required, opened a new log
I20260812 11:11:39.599867 20734 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3d2f7dc51d452887206a627d5c2ad8" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37141 } }
I20260812 11:11:39.600304 20734 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:39.600409 20734 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e3d2f7dc51d452887206a627d5c2ad8, State: Initialized, Role: FOLLOWER
I20260812 11:11:39.601073 20734 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3d2f7dc51d452887206a627d5c2ad8" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37141 } }
I20260812 11:11:39.601392 20734 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:11:39.601553 20734 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:11:39.601732 20734 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:39.604015 20734 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3d2f7dc51d452887206a627d5c2ad8" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37141 } }
I20260812 11:11:39.604585 20734 leader_election.cc:302] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e3d2f7dc51d452887206a627d5c2ad8; no voters:
I20260812 11:11:39.605250 20734 leader_election.cc:288] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:11:39.605383 20742 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:11:39.606216 20742 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [term 1 LEADER]: Becoming Leader. State: Replica: 1e3d2f7dc51d452887206a627d5c2ad8, State: Running, Role: LEADER
I20260812 11:11:39.606781 20742 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3d2f7dc51d452887206a627d5c2ad8" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37141 } }
I20260812 11:11:39.607501 20734 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:11:39.613262 20743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e3d2f7dc51d452887206a627d5c2ad8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3d2f7dc51d452887206a627d5c2ad8" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37141 } } }
I20260812 11:11:39.613719 20743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [sys.catalog]: This master's current role is: LEADER
I20260812 11:11:39.613214 20744 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e3d2f7dc51d452887206a627d5c2ad8. Latest consensus state: current_term: 1 leader_uuid: "1e3d2f7dc51d452887206a627d5c2ad8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e3d2f7dc51d452887206a627d5c2ad8" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37141 } } }
I20260812 11:11:39.614091 20744 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8 [sys.catalog]: This master's current role is: LEADER
W20260812 11:11:39.619005 20760 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:11:39.619141 20760 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:11:39.619239 20761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:11:39.620889 20761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:11:39.630518 20761 catalog_manager.cc:1347] Generated new cluster ID: 226d13ccd1c14ed7abd7ba5258a2735e
I20260812 11:11:39.630656 20761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:11:39.641288 20761 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:11:39.641867 20761 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:11:39.650296 20761 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e3d2f7dc51d452887206a627d5c2ad8: Generated new TSK 0
I20260812 11:11:39.651363 20761 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:11:39.656605 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37141
--builtin_ntp_servers=127.4.26.84:40329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260812 11:11:40.016824 20765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:40.017174 20765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:40.017315 20765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:40.025010 20765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:40.025197 20765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:40.025357 20765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:11:40.034916 20765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37141
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:40.036342 20765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:40.038280 20765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:40.052296 20776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:40.052335 20775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:40.052363 20778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:40.052690 20765 server_base.cc:1034] running on GCE node
I20260812 11:11:40.053717 20765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:40.054690 20765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:40.055887 20765 hybrid_clock.cc:648] HybridClock initialized: now 1786533100055825 us; error 52 us; skew 500 ppm
I20260812 11:11:40.056205 20765 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:11:40.058712 20765 webserver.cc:460] Webserver started at http://127.4.26.65:44509/ using document root <none> and password file <none>
I20260812 11:11:40.059470 20765 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:40.059571 20765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:40.059865 20765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:40.065644 20765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "f3531a6fac10420786a66512244514bb"
format_stamp: "Formatted at 2026-08-12 11:11:40 on dist-test-slave-rmhg"
server_key: "00e5f5a4872ab82677b347a4dff5a1c6"
server_key_iv: "3307e8ca0ccf69ff51c52b87c64ca647"
server_key_version: "encryptionkey@0"
I20260812 11:11:40.066543 20765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "f3531a6fac10420786a66512244514bb"
format_stamp: "Formatted at 2026-08-12 11:11:40 on dist-test-slave-rmhg"
server_key: "00e5f5a4872ab82677b347a4dff5a1c6"
server_key_iv: "3307e8ca0ccf69ff51c52b87c64ca647"
server_key_version: "encryptionkey@0"
I20260812 11:11:40.072486 20765 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260812 11:11:40.077373 20788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:40.079121 20765 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260812 11:11:40.079335 20765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "f3531a6fac10420786a66512244514bb"
format_stamp: "Formatted at 2026-08-12 11:11:40 on dist-test-slave-rmhg"
server_key: "00e5f5a4872ab82677b347a4dff5a1c6"
server_key_iv: "3307e8ca0ccf69ff51c52b87c64ca647"
server_key_version: "encryptionkey@0"
I20260812 11:11:40.079588 20765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:40.086176 20765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:40.087090 20765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:40.087383 20765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:40.088406 20765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:11:40.090101 20765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:40.090222 20765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:40.090337 20765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:40.090408 20765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:40.125190 20765 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:44059
I20260812 11:11:40.125277 20970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:44059 every 8 connection(s)
I20260812 11:11:40.126644 20765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:11:40.127460 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 20765
I20260812 11:11:40.127750 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:11:40.128466 4201 external_mini_cluster.cc:1428] Setting key 2acfdf8ead00920c5d996d8ef5df8bec
I20260812 11:11:40.131767 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37141
--builtin_ntp_servers=127.4.26.84:40329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 11:11:40.137059 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:40.129543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:36435 (local address 127.4.26.126:37141)
0812 11:11:40.130045 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:40.130051 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:40.131743 (+ 1692us) server_negotiation.cc:407] Connection header received
0812 11:11:40.134284 (+ 2541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:40.134289 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:40.134360 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:40.134461 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:40.136264 (+ 1803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:40.136269 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:40.136272 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:11:40.136294 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:40.136343 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:11:40.136357 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:40.136470 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:40.136738 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 11:11:40.136806 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":241,"threads_started":1}
I20260812 11:11:40.138545 20981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:40.130317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37141 (local address 127.4.26.65:36435)
0812 11:11:40.131552 (+ 1235us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:40.131608 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:40.133893 (+ 2285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:40.134766 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:40.134779 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:40.134918 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:40.135719 (+ 801us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:11:40.135722 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:40.135884 (+ 162us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:11:40.136039 (+ 155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:40.136467 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:40.136479 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:40.136487 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 11:11:40.136799 (+ 312us) client_negotiation.cc:240] Negotiation successful
0812 11:11:40.137188 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":320,"threads_started":1}
I20260812 11:11:40.140276 20971 heartbeater.cc:347] Connected to a master server at 127.4.26.126:37141
I20260812 11:11:40.140619 20971 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:40.141311 20971 heartbeater.cc:511] Master 127.4.26.126:37141 requested a full tablet report, sending...
I20260812 11:11:40.143538 20686 ts_manager.cc:194] Registered new tserver with Master: f3531a6fac10420786a66512244514bb (127.4.26.65:44059)
W20260812 11:11:40.483006 20983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:40.483369 20983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:40.483472 20983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:40.490890 20983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:40.491007 20983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:40.491128 20983 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:11:40.500370 20983 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37141
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:40.501844 20983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:40.503705 20983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:40.517887 20996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:40.517853 20993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:40.518585 20983 server_base.cc:1034] running on GCE node
W20260812 11:11:40.521494 20992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:40.522486 20983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:40.523902 20983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:40.525204 20983 hybrid_clock.cc:648] HybridClock initialized: now 1786533100525086 us; error 79 us; skew 500 ppm
I20260812 11:11:40.525645 20983 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:11:40.528743 20983 webserver.cc:460] Webserver started at http://127.4.26.66:41001/ using document root <none> and password file <none>
I20260812 11:11:40.529546 20983 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:40.529659 20983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:40.529965 20983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:40.533001 20983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "cad5a3196a954e51bfdc7ab9fe1bd4ad"
format_stamp: "Formatted at 2026-08-12 11:11:40 on dist-test-slave-rmhg"
server_key: "26f71897ec07443d23b3c342b0dc9312"
server_key_iv: "da57096e7dee8380c7fd26048d479835"
server_key_version: "encryptionkey@0"
I20260812 11:11:40.533887 20983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "cad5a3196a954e51bfdc7ab9fe1bd4ad"
format_stamp: "Formatted at 2026-08-12 11:11:40 on dist-test-slave-rmhg"
server_key: "26f71897ec07443d23b3c342b0dc9312"
server_key_iv: "da57096e7dee8380c7fd26048d479835"
server_key_version: "encryptionkey@0"
I20260812 11:11:40.539685 20983 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:11:40.543617 21004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:40.545099 20983 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:11:40.545308 20983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "cad5a3196a954e51bfdc7ab9fe1bd4ad"
format_stamp: "Formatted at 2026-08-12 11:11:40 on dist-test-slave-rmhg"
server_key: "26f71897ec07443d23b3c342b0dc9312"
server_key_iv: "da57096e7dee8380c7fd26048d479835"
server_key_version: "encryptionkey@0"
I20260812 11:11:40.545522 20983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:40.551614 20983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:40.552460 20983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:40.552706 20983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:40.553740 20983 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:11:40.555248 20983 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:40.555341 20983 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:40.555429 20983 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:40.555483 20983 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:40.590633 20983 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:35561
I20260812 11:11:40.590680 21174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:35561 every 8 connection(s)
I20260812 11:11:40.592088 20983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:11:40.593447 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 20983
I20260812 11:11:40.593655 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:11:40.594213 4201 external_mini_cluster.cc:1428] Setting key 0cdd32bdc62d6e170999e9689af6b938
I20260812 11:11:40.597858 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37141
--builtin_ntp_servers=127.4.26.84:40329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260812 11:11:40.601903 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:40.595165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:47997 (local address 127.4.26.126:37141)
0812 11:11:40.595351 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:40.595357 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:40.597106 (+ 1749us) server_negotiation.cc:407] Connection header received
0812 11:11:40.599493 (+ 2387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:40.599498 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:40.599564 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:40.599659 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:40.601253 (+ 1594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:40.601258 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:40.601261 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:11:40.601279 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:40.601314 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:11:40.601328 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:40.601435 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:40.601626 (+ 191us) server_negotiation.cc:299] Negotiation successful
0812 11:11:40.601686 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:11:40.603216 21178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:40.595773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37141 (local address 127.4.26.66:47997)
0812 11:11:40.596923 (+ 1150us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:40.596982 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:40.599181 (+ 2199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:40.599925 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:40.599936 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:40.600068 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:40.600812 (+ 744us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:11:40.600815 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:40.600868 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:11:40.600983 (+ 115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:40.601424 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:40.601434 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:40.601442 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 11:11:40.601713 (+ 271us) client_negotiation.cc:240] Negotiation successful
0812 11:11:40.601985 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":362,"threads_started":1}
I20260812 11:11:40.604684 21175 heartbeater.cc:347] Connected to a master server at 127.4.26.126:37141
I20260812 11:11:40.605005 21175 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:40.605661 21175 heartbeater.cc:511] Master 127.4.26.126:37141 requested a full tablet report, sending...
I20260812 11:11:40.607084 20686 ts_manager.cc:194] Registered new tserver with Master: cad5a3196a954e51bfdc7ab9fe1bd4ad (127.4.26.66:35561)
W20260812 11:11:40.946557 21181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:40.946861 21181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:40.946980 21181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:40.954504 21181 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:40.954617 21181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:40.954756 21181 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:11:40.964495 21181 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37141
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:40.965969 21181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:40.967857 21181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:40.981271 21186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:40.981308 21190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:40.981305 21188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:40.982470 21181 server_base.cc:1034] running on GCE node
I20260812 11:11:40.983143 21181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:40.984157 21181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:40.985409 21181 hybrid_clock.cc:648] HybridClock initialized: now 1786533100985344 us; error 53 us; skew 500 ppm
I20260812 11:11:40.985762 21181 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:11:40.988166 21181 webserver.cc:460] Webserver started at http://127.4.26.67:36101/ using document root <none> and password file <none>
I20260812 11:11:40.988868 21181 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:40.988984 21181 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:40.989356 21181 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:40.992309 21181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "2b86273c80024c5da6980c6c67512df4"
format_stamp: "Formatted at 2026-08-12 11:11:40 on dist-test-slave-rmhg"
server_key: "491af2fbdc851bd72124926ef73dbefe"
server_key_iv: "806e35e013b34cd786d5a17c510e7307"
server_key_version: "encryptionkey@0"
I20260812 11:11:40.993191 21181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "2b86273c80024c5da6980c6c67512df4"
format_stamp: "Formatted at 2026-08-12 11:11:40 on dist-test-slave-rmhg"
server_key: "491af2fbdc851bd72124926ef73dbefe"
server_key_iv: "806e35e013b34cd786d5a17c510e7307"
server_key_version: "encryptionkey@0"
I20260812 11:11:40.998636 21181 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 11:11:41.002442 21197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:41.003850 21181 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:11:41.004058 21181 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "2b86273c80024c5da6980c6c67512df4"
format_stamp: "Formatted at 2026-08-12 11:11:40 on dist-test-slave-rmhg"
server_key: "491af2fbdc851bd72124926ef73dbefe"
server_key_iv: "806e35e013b34cd786d5a17c510e7307"
server_key_version: "encryptionkey@0"
I20260812 11:11:41.004290 21181 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:41.010823 21181 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:41.011727 21181 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:41.012007 21181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:41.012972 21181 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:11:41.014547 21181 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:41.014652 21181 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:41.014779 21181 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:41.014850 21181 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:41.047618 21181 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:32889
I20260812 11:11:41.047638 21386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:32889 every 8 connection(s)
I20260812 11:11:41.049285 21181 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:11:41.057008 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 21181
I20260812 11:11:41.057263 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:11:41.057806 4201 external_mini_cluster.cc:1428] Setting key 6330d8d1f6af31fd0b0eb844dd1794d4
I20260812 11:11:41.058213 20977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:41.052170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:57817 (local address 127.4.26.126:37141)
0812 11:11:41.052362 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:41.052367 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:41.053949 (+ 1582us) server_negotiation.cc:407] Connection header received
0812 11:11:41.055693 (+ 1744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:41.055700 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:41.055780 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:41.055870 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:41.057427 (+ 1557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:41.057433 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:41.057436 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:11:41.057456 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:41.057500 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:11:41.057514 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:41.057629 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:41.057867 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 11:11:41.057954 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 11:11:41.059382 21391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:41.052760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37141 (local address 127.4.26.67:57817)
0812 11:11:41.053781 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:41.053830 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:41.055398 (+ 1568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:41.056128 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:41.056145 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:41.056259 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:41.056977 (+ 718us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:11:41.056980 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:41.057036 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:11:41.057203 (+ 167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:41.057624 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:41.057635 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:41.057644 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 11:11:41.057941 (+ 297us) client_negotiation.cc:240] Negotiation successful
0812 11:11:41.058261 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":355,"threads_started":1}
I20260812 11:11:41.060953 21389 heartbeater.cc:347] Connected to a master server at 127.4.26.126:37141
I20260812 11:11:41.061306 21389 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:41.061939 21389 heartbeater.cc:511] Master 127.4.26.126:37141 requested a full tablet report, sending...
I20260812 11:11:41.063534 20686 ts_manager.cc:194] Registered new tserver with Master: 2b86273c80024c5da6980c6c67512df4 (127.4.26.67:32889)
I20260812 11:11:41.074012 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260812 11:11:41.080775 20977 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:11:41.079198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56260 (local address 127.4.26.126:37141)
0812 11:11:41.079435 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:41.079440 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:41.079873 (+ 433us) server_negotiation.cc:407] Connection header received
0812 11:11:41.080034 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:41.080038 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:41.080098 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:41.080205 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:41.080553 (+ 348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56260: BlockingRecv error: recv got EOF from 127.0.0.1:56260 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
I20260812 11:11:41.081575 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 20765
I20260812 11:11:41.085546 21401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:41.082810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45014 (local address 127.4.26.65:44059)
0812 11:11:41.083411 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:41.083418 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:41.083448 (+ 30us) server_negotiation.cc:407] Connection header received
0812 11:11:41.083510 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:41.083516 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:41.083768 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:41.083898 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:41.084857 (+ 959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:41.084864 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:41.084879 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:11:41.084899 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:41.084940 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:11:41.084954 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:41.085057 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:41.085191 (+ 134us) server_negotiation.cc:299] Negotiation successful
0812 11:11:41.085279 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":287,"threads_started":1}
I20260812 11:11:41.086786 20965 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:41.168740 20971 heartbeater.cc:503] Master 127.4.26.126:37141 was elected leader, sending a full tablet report...
I20260812 11:11:41.170125 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 20765
W20260812 11:11:41.191778 20665 connection.cc:535] server connection from 127.4.26.65:36435 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 11:11:41.192066 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 20983
I20260812 11:11:41.195653 21404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:41.193183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45938 (local address 127.4.26.66:35561)
0812 11:11:41.193698 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:41.193706 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:41.193734 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:11:41.193801 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:41.193808 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:41.194034 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:41.194174 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:41.195047 (+ 873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:41.195054 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:41.195066 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:11:41.195084 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:41.195139 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:11:41.195154 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:41.195263 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:41.195317 (+ 54us) server_negotiation.cc:299] Negotiation successful
0812 11:11:41.195405 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":233,"threads_started":1}
I20260812 11:11:41.196985 21166 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:41.279227 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 20983
I20260812 11:11:41.303557 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 21181
I20260812 11:11:41.307658 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:41.304647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41760 (local address 127.4.26.67:32889)
0812 11:11:41.305337 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:41.305344 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:41.305376 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:11:41.305442 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:41.305449 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:41.305685 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:41.305812 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:41.306879 (+ 1067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:41.306886 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:41.306898 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:11:41.306915 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:41.306966 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:11:41.306981 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:41.307117 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:41.307255 (+ 138us) server_negotiation.cc:299] Negotiation successful
0812 11:11:41.307345 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":334,"threads_started":1}
I20260812 11:11:41.309144 21382 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:41.390844 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 21181
I20260812 11:11:41.411012 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 20629
I20260812 11:11:41.412281 20724 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:41.514508 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 20629
2026-08-12T11:11:41Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2478 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:11:41 dist-test-slave-rmhg krb5kdc[21414](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:11:41 dist-test-slave-rmhg krb5kdc[21414](info): set up 2 sockets
Aug 12 11:11:41 dist-test-slave-rmhg krb5kdc[21414](info): commencing operation
krb5kdc: starting...
W20260812 11:11:42.780405 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.213s user 0.001s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:11:42 dist-test-slave-rmhg krb5kdc[21414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:11:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:11:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:11:43.062045 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:33357
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:33357
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:11:43.415980 21427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:43.416352 21427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:43.416496 21427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:43.423895 21427 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:11:43.424016 21427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:43.424074 21427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:43.424160 21427 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:11:43.424214 21427 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:11:43.434460 21427 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:33357
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:33357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:43.435861 21427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:43.437242 21427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:43.449331 21436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:43.449363 21434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:43.449331 21433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:43.449738 21427 server_base.cc:1034] running on GCE node
I20260812 11:11:43.450896 21427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:43.452348 21427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:43.453588 21427 hybrid_clock.cc:648] HybridClock initialized: now 1786533103453502 us; error 45 us; skew 500 ppm
I20260812 11:11:43.453948 21427 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:43 dist-test-slave-rmhg krb5kdc[21414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533103, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:43.460863 21427 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:11:43.462743 21427 webserver.cc:460] Webserver started at http://127.4.26.126:38483/ using document root <none> and password file <none>
I20260812 11:11:43.463498 21427 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:43.463635 21427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:43.463958 21427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:43.467175 21427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "a5c5560a5db74ba6aaee8aae1fdea8f7"
format_stamp: "Formatted at 2026-08-12 11:11:43 on dist-test-slave-rmhg"
server_key: "8da15e45c5f0e273c0c38af3dc39125a"
server_key_iv: "6341ce6129737de4d36d88dfdf91218e"
server_key_version: "encryptionkey@0"
I20260812 11:11:43.467962 21427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "a5c5560a5db74ba6aaee8aae1fdea8f7"
format_stamp: "Formatted at 2026-08-12 11:11:43 on dist-test-slave-rmhg"
server_key: "8da15e45c5f0e273c0c38af3dc39125a"
server_key_iv: "6341ce6129737de4d36d88dfdf91218e"
server_key_version: "encryptionkey@0"
I20260812 11:11:43.473759 21427 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260812 11:11:43.477676 21451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:43.479162 21427 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:11:43.479346 21427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "a5c5560a5db74ba6aaee8aae1fdea8f7"
format_stamp: "Formatted at 2026-08-12 11:11:43 on dist-test-slave-rmhg"
server_key: "8da15e45c5f0e273c0c38af3dc39125a"
server_key_iv: "6341ce6129737de4d36d88dfdf91218e"
server_key_version: "encryptionkey@0"
I20260812 11:11:43.479547 21427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:43.502347 21427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:43.506757 21427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:43.507032 21427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:43.524910 21427 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:33357
I20260812 11:11:43.524935 21526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:33357 every 8 connection(s)
I20260812 11:11:43.526332 21427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:11:43.530190 21527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:43.531534 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 21427
I20260812 11:11:43.531801 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:11:43.532606 4201 external_mini_cluster.cc:1428] Setting key a78b746fefdac859eae9a0d9f6133870
I20260812 11:11:43.546097 21527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7: Bootstrap starting.
Aug 12 11:11:43 dist-test-slave-rmhg krb5kdc[21414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:11:43.550312 21527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:43.551606 21527 log.cc:824] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7: Log is configured to *not* fsync() on all Append() calls
I20260812 11:11:43.555215 21527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7: No bootstrap required, opened a new log
I20260812 11:11:43.558869 21533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:43.534887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57980 (local address 127.4.26.126:33357)
0812 11:11:43.535732 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:43.535745 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:43.535795 (+ 50us) server_negotiation.cc:407] Connection header received
0812 11:11:43.537479 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:43.537508 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:43.538013 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:43.538410 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:43.540470 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:43.542048 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:43.544007 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:43.544826 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:43.544980 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:43.550133 (+ 5153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:43.550142 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:43.550170 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:43.550228 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:43.554044 (+ 3816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:43.554845 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:43.554854 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:43.554863 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:43.555101 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:43.555479 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:43.555484 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:43.555487 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:43.556247 (+ 760us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:43.556553 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:43.556866 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 11:11:43.557417 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":385,"threads_started":1}
I20260812 11:11:43.564152 21527 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5c5560a5db74ba6aaee8aae1fdea8f7" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33357 } }
I20260812 11:11:43.564571 21527 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:43.564657 21527 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5c5560a5db74ba6aaee8aae1fdea8f7, State: Initialized, Role: FOLLOWER
I20260812 11:11:43.565207 21527 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5c5560a5db74ba6aaee8aae1fdea8f7" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33357 } }
I20260812 11:11:43.565433 21527 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:11:43.565536 21527 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:11:43.565670 21527 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:43.567942 21527 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5c5560a5db74ba6aaee8aae1fdea8f7" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33357 } }
I20260812 11:11:43.568437 21527 leader_election.cc:302] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5c5560a5db74ba6aaee8aae1fdea8f7; no voters:
I20260812 11:11:43.568997 21527 leader_election.cc:288] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:11:43.569197 21539 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:11:43.570335 21539 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [term 1 LEADER]: Becoming Leader. State: Replica: a5c5560a5db74ba6aaee8aae1fdea8f7, State: Running, Role: LEADER
I20260812 11:11:43.570981 21539 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5c5560a5db74ba6aaee8aae1fdea8f7" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33357 } }
I20260812 11:11:43.571385 21527 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:11:43.573840 21541 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5c5560a5db74ba6aaee8aae1fdea8f7. Latest consensus state: current_term: 1 leader_uuid: "a5c5560a5db74ba6aaee8aae1fdea8f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5c5560a5db74ba6aaee8aae1fdea8f7" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33357 } } }
I20260812 11:11:43.573899 21540 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a5c5560a5db74ba6aaee8aae1fdea8f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5c5560a5db74ba6aaee8aae1fdea8f7" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33357 } } }
I20260812 11:11:43.574236 21541 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [sys.catalog]: This master's current role is: LEADER
I20260812 11:11:43.574290 21540 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7 [sys.catalog]: This master's current role is: LEADER
I20260812 11:11:43.576179 21548 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:11:43.581065 21548 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:11:43.586120 21565 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 11:11:43.591900 21548 catalog_manager.cc:1347] Generated new cluster ID: a00c618b252443cea68ae412c6441972
I20260812 11:11:43.592053 21548 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:11:43.629005 21548 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:11:43.631088 21548 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:11:43.641031 21548 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7: Generated new TSK 0
I20260812 11:11:43.642051 21548 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:11:43.715432 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33357
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:11:44.074383 21569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:44.074716 21569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:44.074841 21569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:44.082675 21569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:44.082818 21569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:44.082991 21569 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:11:44.093569 21569 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:44.095058 21569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:44.096565 21569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:44.111073 21575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:44.111102 21581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:44.111132 21587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:44.112105 21569 server_base.cc:1034] running on GCE node
I20260812 11:11:44.112846 21569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:44.113993 21569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:44.115248 21569 hybrid_clock.cc:648] HybridClock initialized: now 1786533104115178 us; error 67 us; skew 500 ppm
I20260812 11:11:44.115661 21569 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:44 dist-test-slave-rmhg krb5kdc[21414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533104, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:44.119199 21569 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:11:44.120878 21569 webserver.cc:460] Webserver started at http://127.4.26.65:40665/ using document root <none> and password file <none>
I20260812 11:11:44.121685 21569 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:44.121814 21569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:44.122113 21569 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:44.125334 21569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "55223ecd9e634b2db076a3b98ed809fd"
format_stamp: "Formatted at 2026-08-12 11:11:44 on dist-test-slave-rmhg"
server_key: "e1e2c76ab8b1d5a09ad282eb338cd9b7"
server_key_iv: "ef1efecb82b8c10da6dcf2a623ef517a"
server_key_version: "encryptionkey@0"
I20260812 11:11:44.126178 21569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "55223ecd9e634b2db076a3b98ed809fd"
format_stamp: "Formatted at 2026-08-12 11:11:44 on dist-test-slave-rmhg"
server_key: "e1e2c76ab8b1d5a09ad282eb338cd9b7"
server_key_iv: "ef1efecb82b8c10da6dcf2a623ef517a"
server_key_version: "encryptionkey@0"
I20260812 11:11:44.131762 21569 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:11:44.135703 21596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:44.137264 21569 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:11:44.137449 21569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "55223ecd9e634b2db076a3b98ed809fd"
format_stamp: "Formatted at 2026-08-12 11:11:44 on dist-test-slave-rmhg"
server_key: "e1e2c76ab8b1d5a09ad282eb338cd9b7"
server_key_iv: "ef1efecb82b8c10da6dcf2a623ef517a"
server_key_version: "encryptionkey@0"
I20260812 11:11:44.137663 21569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:44.180179 21569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:44.185240 21569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:44.185577 21569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:44.186704 21569 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:11:44.188287 21569 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:44.188370 21569 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:44.188509 21569 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:44.188567 21569 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:44.222380 21569 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:45195
I20260812 11:11:44.222429 21772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:45195 every 8 connection(s)
I20260812 11:11:44.223793 21569 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:11:44.226876 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 21569
I20260812 11:11:44.227109 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:11:44.227968 4201 external_mini_cluster.cc:1428] Setting key cbc8ed40929bff8ab0f8a8c119a6f39d
Aug 12 11:11:44 dist-test-slave-rmhg krb5kdc[21414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533104, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:11:44.249030 21777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:44.226671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:57819 (local address 127.4.26.126:33357)
0812 11:11:44.227212 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:44.227217 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:44.228638 (+ 1421us) server_negotiation.cc:407] Connection header received
0812 11:11:44.231034 (+ 2396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:44.231039 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:44.231111 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:44.231211 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:44.233565 (+ 2354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:44.234381 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:44.236850 (+ 2469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:44.237382 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:44.237511 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:44.242085 (+ 4574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:44.242092 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:44.242097 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:44.242146 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:44.245527 (+ 3381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:44.246404 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:44.246410 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:44.246413 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:44.246567 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:44.247011 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:44.247015 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:44.247018 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:44.247373 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:44.247531 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:44.248407 (+ 876us) server_negotiation.cc:299] Negotiation successful
0812 11:11:44.248663 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":269,"threads_started":1}
I20260812 11:11:44.249943 21778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:44.227399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:33357 (local address 127.4.26.65:57819)
0812 11:11:44.228394 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:44.228449 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:44.230637 (+ 2188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:44.231524 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:44.231536 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:44.232357 (+ 821us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:44.233317 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:44.233349 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:44.234574 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:44.234579 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:44.236594 (+ 2015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:44.236616 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:44.237672 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:44.237680 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:44.238004 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:44.238851 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:44.238885 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:44.241763 (+ 2878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:44.245707 (+ 3944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:44.245716 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:44.245733 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:44.246248 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:44.246663 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:44.246666 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:44.246668 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:44.246870 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:44.247545 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:44.247552 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:44.247976 (+ 424us) client_negotiation.cc:769] Sending connection context
0812 11:11:44.248240 (+ 264us) client_negotiation.cc:240] Negotiation successful
0812 11:11:44.248707 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":697,"thread_start_us":438,"threads_started":1}
I20260812 11:11:44.251585 21773 heartbeater.cc:347] Connected to a master server at 127.4.26.126:33357
I20260812 11:11:44.251943 21773 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:44.253046 21773 heartbeater.cc:511] Master 127.4.26.126:33357 requested a full tablet report, sending...
I20260812 11:11:44.255546 21476 ts_manager.cc:194] Registered new tserver with Master: 55223ecd9e634b2db076a3b98ed809fd (127.4.26.65:45195)
I20260812 11:11:44.257087 21476 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:57819
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:11:44.292618 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33357
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:11:44.645018 21784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:44.645378 21784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:44.645498 21784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:44.653116 21784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:44.653299 21784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:44.653426 21784 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:11:44.663710 21784 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:44.665102 21784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:44.666428 21784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:44.681627 21794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:44.681600 21797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:44.681557 21795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:44.682559 21784 server_base.cc:1034] running on GCE node
I20260812 11:11:44.683224 21784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:44.684306 21784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:44.685523 21784 hybrid_clock.cc:648] HybridClock initialized: now 1786533104685469 us; error 60 us; skew 500 ppm
I20260812 11:11:44.685858 21784 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:44 dist-test-slave-rmhg krb5kdc[21414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533104, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:44.689021 21784 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:11:44.690593 21784 webserver.cc:460] Webserver started at http://127.4.26.66:34287/ using document root <none> and password file <none>
I20260812 11:11:44.691291 21784 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:44.691416 21784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:44.691720 21784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:44.694787 21784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "0183c8d176db4233afe50ad7899be257"
format_stamp: "Formatted at 2026-08-12 11:11:44 on dist-test-slave-rmhg"
server_key: "3f034681018f90c3343802a47c685ef9"
server_key_iv: "b8d0a13b63297a03d0b7b93b7071ff21"
server_key_version: "encryptionkey@0"
I20260812 11:11:44.695590 21784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "0183c8d176db4233afe50ad7899be257"
format_stamp: "Formatted at 2026-08-12 11:11:44 on dist-test-slave-rmhg"
server_key: "3f034681018f90c3343802a47c685ef9"
server_key_iv: "b8d0a13b63297a03d0b7b93b7071ff21"
server_key_version: "encryptionkey@0"
I20260812 11:11:44.701196 21784 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:11:44.704872 21810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:44.706459 21784 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:11:44.706665 21784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "0183c8d176db4233afe50ad7899be257"
format_stamp: "Formatted at 2026-08-12 11:11:44 on dist-test-slave-rmhg"
server_key: "3f034681018f90c3343802a47c685ef9"
server_key_iv: "b8d0a13b63297a03d0b7b93b7071ff21"
server_key_version: "encryptionkey@0"
I20260812 11:11:44.706887 21784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:44.731612 21784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:44.735848 21784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:44.736157 21784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:44.737216 21784 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:11:44.738597 21784 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:44.738675 21784 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:44.738792 21784 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:44.738854 21784 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:44.770689 21784 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:44145
I20260812 11:11:44.770769 21989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:44145 every 8 connection(s)
I20260812 11:11:44.772050 21784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:11:44.781893 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 21784
I20260812 11:11:44.782104 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:11:44.782541 4201 external_mini_cluster.cc:1428] Setting key 15296cab2ba5bae91e12288e564274d3
Aug 12 11:11:44 dist-test-slave-rmhg krb5kdc[21414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533104, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:11:44.793783 21995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:44.774793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:41067 (local address 127.4.26.126:33357)
0812 11:11:44.775274 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:44.775281 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:44.776412 (+ 1131us) server_negotiation.cc:407] Connection header received
0812 11:11:44.778657 (+ 2245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:44.778662 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:44.778745 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:44.778846 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:44.780540 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:44.781356 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:44.783188 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:44.783660 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:44.783800 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:44.787626 (+ 3826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:44.787632 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:44.787635 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:44.787675 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:44.790317 (+ 2642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:44.791173 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:44.791177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:44.791180 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:44.791319 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:44.791848 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:44.791852 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:44.791854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:44.792164 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:44.792320 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:44.793121 (+ 801us) server_negotiation.cc:299] Negotiation successful
0812 11:11:44.793416 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":208,"threads_started":1}
I20260812 11:11:44.794866 21996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:44.775404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:33357 (local address 127.4.26.66:41067)
0812 11:11:44.776225 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:44.776282 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:44.778330 (+ 2048us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:44.779067 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:44.779076 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:44.779674 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:44.780299 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:44.780319 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:44.781526 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:44.781530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:44.782980 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:44.782995 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:44.783889 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:44.783894 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:44.784116 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:44.784866 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:44.784892 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:44.787356 (+ 2464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:44.790498 (+ 3142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:44.790517 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:44.790533 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:44.791023 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:44.791445 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:44.791450 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:44.791453 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:44.791715 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:44.792315 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:44.792324 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:44.792709 (+ 385us) client_negotiation.cc:769] Sending connection context
0812 11:11:44.792979 (+ 270us) client_negotiation.cc:240] Negotiation successful
0812 11:11:44.793624 (+ 645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":297,"threads_started":1}
I20260812 11:11:44.796519 21991 heartbeater.cc:347] Connected to a master server at 127.4.26.126:33357
I20260812 11:11:44.796906 21991 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:44.797909 21991 heartbeater.cc:511] Master 127.4.26.126:33357 requested a full tablet report, sending...
I20260812 11:11:44.799872 21476 ts_manager.cc:194] Registered new tserver with Master: 0183c8d176db4233afe50ad7899be257 (127.4.26.66:44145)
I20260812 11:11:44.800992 21476 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:41067
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:11:44.849433 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33357
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:11:45.199527 22000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:11:45.199853 22000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:11:45.199947 22000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:11:45.207752 22000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:11:45.207887 22000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:11:45.208001 22000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:11:45.218431 22000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:33357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:11:45.219873 22000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:11:45.221487 22000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:11:45.235783 22016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:45.235942 22017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:11:45.235920 22020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:11:45.236727 22000 server_base.cc:1034] running on GCE node
I20260812 11:11:45.237478 22000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:11:45.238659 22000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:11:45.239898 22000 hybrid_clock.cc:648] HybridClock initialized: now 1786533105239849 us; error 40 us; skew 500 ppm
I20260812 11:11:45.240303 22000 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:11:45 dist-test-slave-rmhg krb5kdc[21414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533105, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:11:45.248018 22000 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:11:45.249925 22000 webserver.cc:460] Webserver started at http://127.4.26.67:39921/ using document root <none> and password file <none>
I20260812 11:11:45.250751 22000 fs_manager.cc:359] Metadata directory not provided
I20260812 11:11:45.250880 22000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:11:45.251214 22000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:11:45.254654 22000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "1384503fdfa248c8b435ead8bccbf6d2"
format_stamp: "Formatted at 2026-08-12 11:11:45 on dist-test-slave-rmhg"
server_key: "6524cf95c0088ffd52d078d4c2aef3e2"
server_key_iv: "9c52d33e8e05f09ad2f9a5473f9317ed"
server_key_version: "encryptionkey@0"
I20260812 11:11:45.255573 22000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "1384503fdfa248c8b435ead8bccbf6d2"
format_stamp: "Formatted at 2026-08-12 11:11:45 on dist-test-slave-rmhg"
server_key: "6524cf95c0088ffd52d078d4c2aef3e2"
server_key_iv: "9c52d33e8e05f09ad2f9a5473f9317ed"
server_key_version: "encryptionkey@0"
I20260812 11:11:45.260883 21773 heartbeater.cc:503] Master 127.4.26.126:33357 was elected leader, sending a full tablet report...
I20260812 11:11:45.261600 22000 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.003s
I20260812 11:11:45.265615 22028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:45.267413 22000 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:11:45.267620 22000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "1384503fdfa248c8b435ead8bccbf6d2"
format_stamp: "Formatted at 2026-08-12 11:11:45 on dist-test-slave-rmhg"
server_key: "6524cf95c0088ffd52d078d4c2aef3e2"
server_key_iv: "9c52d33e8e05f09ad2f9a5473f9317ed"
server_key_version: "encryptionkey@0"
I20260812 11:11:45.267841 22000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:11:45.291489 22000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:11:45.296798 22000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:11:45.297187 22000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:11:45.298336 22000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:11:45.300133 22000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:11:45.300246 22000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:45.300376 22000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:11:45.300439 22000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:11:45.355357 22000 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:40621
I20260812 11:11:45.355458 22221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:40621 every 8 connection(s)
I20260812 11:11:45.356914 22000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:11:45.361078 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 22000
I20260812 11:11:45.361349 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:11:45.361923 4201 external_mini_cluster.cc:1428] Setting key 4f0ee5bfea22a5d778fa52fee884d9c8
Aug 12 11:11:45 dist-test-slave-rmhg krb5kdc[21414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533105, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:11:45.379911 22224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.360406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:45839 (local address 127.4.26.126:33357)
0812 11:11:45.360962 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:45.360967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:45.364734 (+ 3767us) server_negotiation.cc:407] Connection header received
0812 11:11:45.364794 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:45.364798 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:45.364870 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:45.364962 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:45.366788 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.367614 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.369359 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.369789 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.369909 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.373878 (+ 3969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:45.373883 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:45.373887 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:45.373925 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:45.376641 (+ 2716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:45.377498 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:45.377502 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:45.377504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:45.377640 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:45.378083 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:45.378087 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:45.378088 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:45.378366 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:45.378513 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:45.379294 (+ 781us) server_negotiation.cc:299] Negotiation successful
0812 11:11:45.379546 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":303,"threads_started":1}
I20260812 11:11:45.380918 22225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.361073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:33357 (local address 127.4.26.67:45839)
0812 11:11:45.362133 (+ 1060us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:45.362188 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:45.364351 (+ 2163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:45.365331 (+ 980us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:45.365341 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:45.365921 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:11:45.366567 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:45.366593 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.367788 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.367794 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:45.369205 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:45.369223 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.370046 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.370054 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:45.370295 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.370957 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:11:45.370980 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:11:45.373599 (+ 2619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:11:45.376790 (+ 3191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:45.376801 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:45.376818 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:45.377365 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:45.377757 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:11:45.377762 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:11:45.377764 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:11:45.377958 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:11:45.378503 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:11:45.378511 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:11:45.378873 (+ 362us) client_negotiation.cc:769] Sending connection context
0812 11:11:45.379150 (+ 277us) client_negotiation.cc:240] Negotiation successful
0812 11:11:45.379736 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"thread_start_us":378,"threads_started":1}
I20260812 11:11:45.382414 22222 heartbeater.cc:347] Connected to a master server at 127.4.26.126:33357
I20260812 11:11:45.382736 22222 heartbeater.cc:464] Registering TS with master...
I20260812 11:11:45.383631 22222 heartbeater.cc:511] Master 127.4.26.126:33357 requested a full tablet report, sending...
I20260812 11:11:45.385313 21476 ts_manager.cc:194] Registered new tserver with Master: 1384503fdfa248c8b435ead8bccbf6d2 (127.4.26.67:40621)
I20260812 11:11:45.386183 21476 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:45839
I20260812 11:11:45.390300 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:11:45.407670 22224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.394858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57986 (local address 127.4.26.126:33357)
0812 11:11:45.395082 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:45.395090 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:45.395431 (+ 341us) server_negotiation.cc:407] Connection header received
0812 11:11:45.395566 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:45.395569 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:45.395635 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:45.395763 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:45.397285 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.398043 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.399349 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.399770 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.399868 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.402296 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:45.402302 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:45.402305 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:45.402344 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:45.404951 (+ 2607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:45.405742 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:45.405747 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:45.405749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:45.405882 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:45.406272 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:45.406275 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:45.406277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:45.406601 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:45.406793 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:45.407154 (+ 361us) server_negotiation.cc:299] Negotiation successful
0812 11:11:45.407340 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 11:11:45.412007 21476 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57986:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:11:45.419097 21476 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:11:45.456195 22251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.432057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:44145 (local address 127.0.0.1:44010)
0812 11:11:45.446642 (+ 14585us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:45.446659 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:45.446785 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:45.447894 (+ 1109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:45.447902 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:45.447933 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:45.448408 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:45.448423 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.450463 (+ 2040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.450469 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:45.452841 (+ 2372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:45.452857 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.455044 (+ 2187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.455051 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:45.455255 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.455311 (+ 56us) client_negotiation.cc:769] Sending connection context
0812 11:11:45.455450 (+ 139us) client_negotiation.cc:240] Negotiation successful
0812 11:11:45.455659 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14460,"mutex_wait_us":21,"thread_start_us":12914,"threads_started":1}
I20260812 11:11:45.456564 22246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.432365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44010 (local address 127.4.26.66:44145)
0812 11:11:45.444747 (+ 12382us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:45.444760 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:45.446928 (+ 2168us) server_negotiation.cc:407] Connection header received
0812 11:11:45.447057 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:45.447065 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:45.447368 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:45.447574 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:45.448656 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.450294 (+ 1638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.453024 (+ 2730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.454538 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.454671 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.454901 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:45.456041 (+ 1140us) server_negotiation.cc:299] Negotiation successful
0812 11:11:45.456230 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12144,"thread_start_us":13555,"threads_started":1}
I20260812 11:11:45.456674 22242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.431837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:40621 (local address 127.0.0.1:46018)
0812 11:11:45.445421 (+ 13584us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:45.445479 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:45.445707 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:45.449722 (+ 4015us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:45.449726 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:45.449751 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:45.450128 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:45.450141 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.452109 (+ 1968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.452115 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:45.453938 (+ 1823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:45.453952 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.455841 (+ 1889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.455849 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:45.456044 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.456081 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:11:45.456172 (+ 91us) client_negotiation.cc:240] Negotiation successful
0812 11:11:45.456302 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13284,"mutex_wait_us":20,"thread_start_us":17230,"threads_started":1}
I20260812 11:11:45.457475 22245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.432068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46018 (local address 127.4.26.67:40621)
0812 11:11:45.449040 (+ 16972us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:45.449049 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:45.449096 (+ 47us) server_negotiation.cc:407] Connection header received
0812 11:11:45.449225 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:45.449233 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:45.449500 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:45.449730 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:45.450341 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.451953 (+ 1612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.454129 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.455318 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.455442 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.455676 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:45.456944 (+ 1268us) server_negotiation.cc:299] Negotiation successful
0812 11:11:45.457122 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16783,"thread_start_us":16612,"threads_started":1}
I20260812 11:11:45.457554 22240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.434190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45195 (local address 127.0.0.1:43058)
0812 11:11:45.449366 (+ 15176us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:45.449383 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:45.449607 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:45.450561 (+ 954us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:45.450566 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:45.450597 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:45.451057 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:45.451070 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.452690 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.452698 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:45.454785 (+ 2087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:45.454799 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.456926 (+ 2127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.456932 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:45.457090 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.457122 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 11:11:45.457229 (+ 107us) client_negotiation.cc:240] Negotiation successful
0812 11:11:45.457330 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15051,"thread_start_us":12158,"threads_started":1}
I20260812 11:11:45.458573 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.434481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43058 (local address 127.4.26.65:45195)
0812 11:11:45.448479 (+ 13998us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:45.448488 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:45.449504 (+ 1016us) server_negotiation.cc:407] Connection header received
0812 11:11:45.449811 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:45.449818 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:45.450099 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:45.450296 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:45.451285 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.452536 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.454975 (+ 2439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.456437 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.456551 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.456784 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:45.457704 (+ 920us) server_negotiation.cc:299] Negotiation successful
0812 11:11:45.458249 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13809,"thread_start_us":13658,"threads_started":1}
I20260812 11:11:45.461047 21894 tablet_service.cc:1467] Processing CreateTablet for tablet 82bed8d727364fc1a6f3a47180f99aa7 (DEFAULT_TABLE table=test-table [id=c42f7b17fa8c4614acc9f0cc7aa75a1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:45.461184 22120 tablet_service.cc:1467] Processing CreateTablet for tablet 82bed8d727364fc1a6f3a47180f99aa7 (DEFAULT_TABLE table=test-table [id=c42f7b17fa8c4614acc9f0cc7aa75a1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:45.462495 21894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82bed8d727364fc1a6f3a47180f99aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:45.462634 22120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82bed8d727364fc1a6f3a47180f99aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:45.462293 21675 tablet_service.cc:1467] Processing CreateTablet for tablet 82bed8d727364fc1a6f3a47180f99aa7 (DEFAULT_TABLE table=test-table [id=c42f7b17fa8c4614acc9f0cc7aa75a1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:11:45.463773 21675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82bed8d727364fc1a6f3a47180f99aa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:11:45.478509 22258 tablet_bootstrap.cc:492] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd: Bootstrap starting.
I20260812 11:11:45.480782 22253 tablet_bootstrap.cc:492] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257: Bootstrap starting.
I20260812 11:11:45.482795 22258 tablet_bootstrap.cc:654] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:45.482846 22257 tablet_bootstrap.cc:492] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2: Bootstrap starting.
I20260812 11:11:45.485034 22253 tablet_bootstrap.cc:654] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:45.485569 22258 log.cc:824] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd: Log is configured to *not* fsync() on all Append() calls
I20260812 11:11:45.486407 22257 tablet_bootstrap.cc:654] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2: Neither blocks nor log segments found. Creating new log.
I20260812 11:11:45.486402 22253 log.cc:824] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257: Log is configured to *not* fsync() on all Append() calls
I20260812 11:11:45.487370 22257 log.cc:824] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2: Log is configured to *not* fsync() on all Append() calls
I20260812 11:11:45.492439 22258 tablet_bootstrap.cc:492] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd: No bootstrap required, opened a new log
I20260812 11:11:45.492851 22258 ts_tablet_manager.cc:1397] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260812 11:11:45.493134 22253 tablet_bootstrap.cc:492] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257: No bootstrap required, opened a new log
I20260812 11:11:45.493577 22253 ts_tablet_manager.cc:1397] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.005s
I20260812 11:11:45.493707 22257 tablet_bootstrap.cc:492] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2: No bootstrap required, opened a new log
I20260812 11:11:45.493956 22257 ts_tablet_manager.cc:1397] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20260812 11:11:45.501362 22257 raft_consensus.cc:348] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1384503fdfa248c8b435ead8bccbf6d2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40621 } } peers { permanent_uuid: "0183c8d176db4233afe50ad7899be257" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 44145 } } peers { permanent_uuid: "55223ecd9e634b2db076a3b98ed809fd" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45195 } }
I20260812 11:11:45.501785 22257 raft_consensus.cc:374] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:45.501904 22257 raft_consensus.cc:729] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1384503fdfa248c8b435ead8bccbf6d2, State: Initialized, Role: FOLLOWER
I20260812 11:11:45.502609 22257 consensus_queue.cc:260] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1384503fdfa248c8b435ead8bccbf6d2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40621 } } peers { permanent_uuid: "0183c8d176db4233afe50ad7899be257" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 44145 } } peers { permanent_uuid: "55223ecd9e634b2db076a3b98ed809fd" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45195 } }
I20260812 11:11:45.503762 22222 heartbeater.cc:503] Master 127.4.26.126:33357 was elected leader, sending a full tablet report...
I20260812 11:11:45.504103 22258 raft_consensus.cc:348] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1384503fdfa248c8b435ead8bccbf6d2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40621 } } peers { permanent_uuid: "0183c8d176db4233afe50ad7899be257" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 44145 } } peers { permanent_uuid: "55223ecd9e634b2db076a3b98ed809fd" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45195 } }
I20260812 11:11:45.504102 22253 raft_consensus.cc:348] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1384503fdfa248c8b435ead8bccbf6d2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40621 } } peers { permanent_uuid: "0183c8d176db4233afe50ad7899be257" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 44145 } } peers { permanent_uuid: "55223ecd9e634b2db076a3b98ed809fd" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45195 } }
I20260812 11:11:45.504549 22257 ts_tablet_manager.cc:1428] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2: Time spent starting tablet: real 0.010s user 0.002s sys 0.008s
I20260812 11:11:45.504583 22253 raft_consensus.cc:374] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:45.504585 22258 raft_consensus.cc:374] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:11:45.504685 22253 raft_consensus.cc:729] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0183c8d176db4233afe50ad7899be257, State: Initialized, Role: FOLLOWER
I20260812 11:11:45.504689 22258 raft_consensus.cc:729] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55223ecd9e634b2db076a3b98ed809fd, State: Initialized, Role: FOLLOWER
I20260812 11:11:45.505352 22253 consensus_queue.cc:260] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1384503fdfa248c8b435ead8bccbf6d2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40621 } } peers { permanent_uuid: "0183c8d176db4233afe50ad7899be257" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 44145 } } peers { permanent_uuid: "55223ecd9e634b2db076a3b98ed809fd" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45195 } }
I20260812 11:11:45.505611 22258 consensus_queue.cc:260] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1384503fdfa248c8b435ead8bccbf6d2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40621 } } peers { permanent_uuid: "0183c8d176db4233afe50ad7899be257" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 44145 } } peers { permanent_uuid: "55223ecd9e634b2db076a3b98ed809fd" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45195 } }
I20260812 11:11:45.509550 22258 ts_tablet_manager.cc:1428] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd: Time spent starting tablet: real 0.017s user 0.010s sys 0.004s
I20260812 11:11:45.511173 21991 heartbeater.cc:503] Master 127.4.26.126:33357 was elected leader, sending a full tablet report...
I20260812 11:11:45.512876 22253 ts_tablet_manager.cc:1428] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257: Time spent starting tablet: real 0.019s user 0.005s sys 0.011s
I20260812 11:11:45.515565 22266 raft_consensus.cc:482] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:11:45.515801 22266 raft_consensus.cc:504] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1384503fdfa248c8b435ead8bccbf6d2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40621 } } peers { permanent_uuid: "0183c8d176db4233afe50ad7899be257" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 44145 } } peers { permanent_uuid: "55223ecd9e634b2db076a3b98ed809fd" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45195 } }
I20260812 11:11:45.517428 22266 leader_election.cc:288] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1384503fdfa248c8b435ead8bccbf6d2 (127.4.26.67:40621), 0183c8d176db4233afe50ad7899be257 (127.4.26.66:44145)
W20260812 11:11:45.524168 21993 tablet.cc:2369] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:11:45.526602 22246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.517926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:43703 (local address 127.4.26.66:44145)
0812 11:11:45.518103 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:45.518107 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:45.518768 (+ 661us) server_negotiation.cc:407] Connection header received
0812 11:11:45.518985 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:45.518990 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:45.519055 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:45.519169 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:45.519876 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.521009 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.523971 (+ 2962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.525309 (+ 1338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.525465 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.525566 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:45.526193 (+ 627us) server_negotiation.cc:299] Negotiation successful
0812 11:11:45.526347 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:11:45.526715 22270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.517861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:44145 (local address 127.4.26.65:43703)
0812 11:11:45.518660 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:45.518677 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:45.518861 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:45.519179 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:45.519183 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:45.519200 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:45.519705 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:45.519718 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.521176 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.521183 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:45.523770 (+ 2587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:45.523787 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.525739 (+ 1952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.525746 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:45.525935 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.525973 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 11:11:45.526122 (+ 149us) client_negotiation.cc:240] Negotiation successful
0812 11:11:45.526288 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"mutex_wait_us":111,"spinlock_wait_cycles":25984,"thread_start_us":493,"threads_started":1}
I20260812 11:11:45.527860 22245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.517946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:48159 (local address 127.4.26.67:40621)
0812 11:11:45.518352 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:45.518358 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:45.518811 (+ 453us) server_negotiation.cc:407] Connection header received
0812 11:11:45.518953 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:45.518957 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:45.519033 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:45.519140 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:11:45.519876 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.521029 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.525331 (+ 4302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.526553 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.526696 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.526803 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:45.527493 (+ 690us) server_negotiation.cc:299] Negotiation successful
0812 11:11:45.527626 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252}
I20260812 11:11:45.527966 22268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.517663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:40621 (local address 127.4.26.65:48159)
0812 11:11:45.518657 (+ 994us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:45.518682 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:11:45.518828 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:11:45.519159 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:11:45.519164 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:11:45.519191 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:11:45.519718 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:45.519728 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.521194 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.521199 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:45.523768 (+ 2569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:11:45.523787 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.527135 (+ 3348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.527142 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:11:45.527315 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.527351 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:11:45.527446 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 11:11:45.527591 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":842,"mutex_wait_us":119,"thread_start_us":616,"threads_started":1}
I20260812 11:11:45.527866 21921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82bed8d727364fc1a6f3a47180f99aa7" candidate_uuid: "55223ecd9e634b2db076a3b98ed809fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0183c8d176db4233afe50ad7899be257" is_pre_election: true
I20260812 11:11:45.528501 21921 raft_consensus.cc:2454] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55223ecd9e634b2db076a3b98ed809fd in term 0.
I20260812 11:11:45.529031 22147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82bed8d727364fc1a6f3a47180f99aa7" candidate_uuid: "55223ecd9e634b2db076a3b98ed809fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1384503fdfa248c8b435ead8bccbf6d2" is_pre_election: true
I20260812 11:11:45.529340 21599 leader_election.cc:302] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0183c8d176db4233afe50ad7899be257, 55223ecd9e634b2db076a3b98ed809fd; no voters:
I20260812 11:11:45.529665 22147 raft_consensus.cc:2454] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55223ecd9e634b2db076a3b98ed809fd in term 0.
I20260812 11:11:45.529786 22266 raft_consensus.cc:2781] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:11:45.529937 22266 raft_consensus.cc:482] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:11:45.530023 22266 raft_consensus.cc:3037] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:45.533335 22266 raft_consensus.cc:504] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1384503fdfa248c8b435ead8bccbf6d2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40621 } } peers { permanent_uuid: "0183c8d176db4233afe50ad7899be257" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 44145 } } peers { permanent_uuid: "55223ecd9e634b2db076a3b98ed809fd" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45195 } }
I20260812 11:11:45.534153 22266 leader_election.cc:288] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [CANDIDATE]: Term 1 election: Requested vote from peers 1384503fdfa248c8b435ead8bccbf6d2 (127.4.26.67:40621), 0183c8d176db4233afe50ad7899be257 (127.4.26.66:44145)
I20260812 11:11:45.534744 21921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82bed8d727364fc1a6f3a47180f99aa7" candidate_uuid: "55223ecd9e634b2db076a3b98ed809fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0183c8d176db4233afe50ad7899be257"
I20260812 11:11:45.534749 22147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82bed8d727364fc1a6f3a47180f99aa7" candidate_uuid: "55223ecd9e634b2db076a3b98ed809fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1384503fdfa248c8b435ead8bccbf6d2"
I20260812 11:11:45.534957 21921 raft_consensus.cc:3037] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:45.534965 22147 raft_consensus.cc:3037] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:11:45.537263 21921 raft_consensus.cc:2454] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55223ecd9e634b2db076a3b98ed809fd in term 1.
I20260812 11:11:45.537750 21599 leader_election.cc:302] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0183c8d176db4233afe50ad7899be257, 55223ecd9e634b2db076a3b98ed809fd; no voters:
I20260812 11:11:45.538065 22266 raft_consensus.cc:2781] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:11:45.538305 22147 raft_consensus.cc:2454] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55223ecd9e634b2db076a3b98ed809fd in term 1.
I20260812 11:11:45.538581 22266 raft_consensus.cc:686] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [term 1 LEADER]: Becoming Leader. State: Replica: 55223ecd9e634b2db076a3b98ed809fd, State: Running, Role: LEADER
I20260812 11:11:45.539242 22266 consensus_queue.cc:237] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1384503fdfa248c8b435ead8bccbf6d2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40621 } } peers { permanent_uuid: "0183c8d176db4233afe50ad7899be257" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 44145 } } peers { permanent_uuid: "55223ecd9e634b2db076a3b98ed809fd" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45195 } }
I20260812 11:11:45.544687 21473 catalog_manager.cc:5495] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 55223ecd9e634b2db076a3b98ed809fd (127.4.26.65). New cstate: current_term: 1 leader_uuid: "55223ecd9e634b2db076a3b98ed809fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1384503fdfa248c8b435ead8bccbf6d2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0183c8d176db4233afe50ad7899be257" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 44145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55223ecd9e634b2db076a3b98ed809fd" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45195 } health_report { overall_health: HEALTHY } } }
I20260812 11:11:45.583911 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.577990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43074 (local address 127.4.26.65:45195)
0812 11:11:45.578223 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:45.578229 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:45.578274 (+ 45us) server_negotiation.cc:407] Connection header received
0812 11:11:45.578594 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:45.578598 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:45.578692 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:45.578846 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:11:45.579286 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.580030 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.581526 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.581978 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.582101 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.582671 (+ 570us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:11:45.583270 (+ 599us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:11:45.583435 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:45.583542 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 11:11:45.583646 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 11:11:45.597081 21921 raft_consensus.cc:1261] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257 [term 1 FOLLOWER]: Refusing update from remote peer 55223ecd9e634b2db076a3b98ed809fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:11:45.597209 22147 raft_consensus.cc:1261] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2 [term 1 FOLLOWER]: Refusing update from remote peer 55223ecd9e634b2db076a3b98ed809fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:11:45.598201 22266 consensus_queue.cc:1035] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0183c8d176db4233afe50ad7899be257" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 44145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:11:45.598551 22273 consensus_queue.cc:1035] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1384503fdfa248c8b435ead8bccbf6d2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:11:45.608806 22223 tablet.cc:2369] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:11:45.613085 22284 mvcc.cc:205] Tried to move back new op lower bound from 7317639600498700288 to 7317639600292794368. Current Snapshot: MvccSnapshot[applied={T|T < 7317639600498700288}]
I20260812 11:11:45.625347 21475 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:11:45.625619 21475 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:11:45.629436 21475 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a5c5560a5db74ba6aaee8aae1fdea8f7: Sending DeleteTablet for 3 replicas of tablet 82bed8d727364fc1a6f3a47180f99aa7
I20260812 11:11:45.630929 22120 tablet_service.cc:1514] Processing DeleteTablet for tablet 82bed8d727364fc1a6f3a47180f99aa7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:45 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:46018
I20260812 11:11:45.630940 21894 tablet_service.cc:1514] Processing DeleteTablet for tablet 82bed8d727364fc1a6f3a47180f99aa7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:45 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:44010
I20260812 11:11:45.631181 21675 tablet_service.cc:1514] Processing DeleteTablet for tablet 82bed8d727364fc1a6f3a47180f99aa7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:11:45 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:43058
I20260812 11:11:45.633378 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 21569
I20260812 11:11:45.660048 22297 tablet_replica.cc:330] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd: stopping tablet replica
I20260812 11:11:45.660715 22297 raft_consensus.cc:2229] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:11:45.662050 22297 raft_consensus.cc:2258] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:45.663079 22296 tablet_replica.cc:330] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2: stopping tablet replica
I20260812 11:11:45.665321 22297 ts_tablet_manager.cc:1905] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:45.665992 22296 raft_consensus.cc:2229] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:11:45.666960 22296 raft_consensus.cc:2258] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:11:45.668320 22294 tablet_replica.cc:330] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257: stopping tablet replica
I20260812 11:11:45.668802 22294 raft_consensus.cc:2229] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:11:45.669405 22294 raft_consensus.cc:2258] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 12 11:11:45 dist-test-slave-rmhg krb5kdc[21414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:11:45.670450 22296 ts_tablet_manager.cc:1905] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:45.671674 22294 ts_tablet_manager.cc:1905] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:11:45.678320 22296 ts_tablet_manager.cc:1918] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:11:45.678520 22296 log.cc:1196] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/82bed8d727364fc1a6f3a47180f99aa7
I20260812 11:11:45.678961 22294 ts_tablet_manager.cc:1918] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:11:45.679090 22296 ts_tablet_manager.cc:1939] T 82bed8d727364fc1a6f3a47180f99aa7 P 1384503fdfa248c8b435ead8bccbf6d2: Deleting consensus metadata
I20260812 11:11:45.679142 22294 log.cc:1196] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/82bed8d727364fc1a6f3a47180f99aa7
I20260812 11:11:45.679639 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.634890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43078 (local address 127.4.26.65:45195)
0812 11:11:45.635062 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:45.635067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:45.659072 (+ 24005us) server_negotiation.cc:407] Connection header received
0812 11:11:45.659284 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:45.659290 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:45.659444 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:45.659567 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:45.661451 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.662647 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.664606 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.665521 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.665632 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.670969 (+ 5337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:45.670994 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:45.671015 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:45.671071 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:45.675524 (+ 4453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:45.676685 (+ 1161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:45.676695 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:45.676699 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:45.676886 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:45.677474 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:45.677478 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:45.677481 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:45.678046 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:45.678367 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:45.679003 (+ 636us) server_negotiation.cc:299] Negotiation successful
0812 11:11:45.679268 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260812 11:11:45.679641 22294 ts_tablet_manager.cc:1939] T 82bed8d727364fc1a6f3a47180f99aa7 P 0183c8d176db4233afe50ad7899be257: Deleting consensus metadata
I20260812 11:11:45.681399 21767 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:45.681507 21454 catalog_manager.cc:4841] TS 1384503fdfa248c8b435ead8bccbf6d2 (127.4.26.67:40621): tablet 82bed8d727364fc1a6f3a47180f99aa7 (table test-table [id=c42f7b17fa8c4614acc9f0cc7aa75a1c]) successfully deleted
I20260812 11:11:45.681536 21453 catalog_manager.cc:4841] TS 0183c8d176db4233afe50ad7899be257 (127.4.26.66:44145): tablet 82bed8d727364fc1a6f3a47180f99aa7 (table test-table [id=c42f7b17fa8c4614acc9f0cc7aa75a1c]) successfully deleted
I20260812 11:11:45.782058 22297 ts_tablet_manager.cc:1918] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:11:45.782382 22297 log.cc:1196] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/82bed8d727364fc1a6f3a47180f99aa7
I20260812 11:11:45.782961 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 21569
I20260812 11:11:45.783123 22297 ts_tablet_manager.cc:1939] T 82bed8d727364fc1a6f3a47180f99aa7 P 55223ecd9e634b2db076a3b98ed809fd: Deleting consensus metadata
I20260812 11:11:45.810632 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 21784
W20260812 11:11:45.810683 21452 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.26.65:45195 (error 108)
I20260812 11:11:45.812702 22240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.812268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45195 (local address 127.0.0.1:43082)
0812 11:11:45.812417 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:45.812561 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:45195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260812 11:11:45.812916 21452 catalog_manager.cc:4584] TS 55223ecd9e634b2db076a3b98ed809fd (127.4.26.65:45195): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 82bed8d727364fc1a6f3a47180f99aa7: Network error: Client connection negotiation failed: client connection to 127.4.26.65:45195: connect: Connection refused (error 111)
Aug 12 11:11:45 dist-test-slave-rmhg krb5kdc[21414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:11:45.825970 22246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.811538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44018 (local address 127.4.26.66:44145)
0812 11:11:45.811755 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:45.811760 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:45.811778 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:11:45.811929 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:45.811933 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:45.812027 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:45.812152 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:45.813561 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.814324 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.815481 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.815889 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.816000 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.820235 (+ 4235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:45.820253 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:45.820273 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:45.820316 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:45.823268 (+ 2952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:45.824042 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:45.824050 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:45.824052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:45.824184 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:45.824513 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:45.824516 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:45.824518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:45.824917 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:45.825169 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:45.825485 (+ 316us) server_negotiation.cc:299] Negotiation successful
0812 11:11:45.825697 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260812 11:11:45.826738 21982 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:45.866710 22240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.866112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45195 (local address 127.0.0.1:43090)
0812 11:11:45.866358 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:45.866488 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:45195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260812 11:11:45.867918 22240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.867467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45195 (local address 127.0.0.1:43098)
0812 11:11:45.867644 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:45.867749 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:45195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 11:11:45.916899 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 21784
I20260812 11:11:45.928570 22240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.927977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45195 (local address 127.0.0.1:43102)
0812 11:11:45.928251 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:45.928361 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:45195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260812 11:11:45.929709 22240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.929321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45195 (local address 127.0.0.1:43104)
0812 11:11:45.929485 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:45.929569 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:45195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 11:11:45.941051 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 22000
Aug 12 11:11:45 dist-test-slave-rmhg krb5kdc[21414](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:11:45.956476 22245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:45.941882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46020 (local address 127.4.26.67:40621)
0812 11:11:45.942080 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 11:11:45.942086 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:11:45.942108 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:11:45.942262 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:11:45.942268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:11:45.942344 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:11:45.942446 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:11:45.943741 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.944491 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.946033 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:11:45.946454 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:11:45.946575 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:11:45.950908 (+ 4333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:11:45.950926 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:11:45.950945 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:11:45.950985 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:11:45.953733 (+ 2748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:45.954407 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:45.954415 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:45.954417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:45.954551 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:11:45.954927 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:11:45.954930 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:11:45.954932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:11:45.955312 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:11:45.955596 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0812 11:11:45.955919 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 11:11:45.956163 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 11:11:45.957185 22215 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:46.010640 22240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:46.010023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45195 (local address 127.0.0.1:43106)
0812 11:11:46.010323 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:46.010452 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:45195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260812 11:11:46.011795 22240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:11:46.011341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45195 (local address 127.0.0.1:43112)
0812 11:11:46.011550 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0812 11:11:46.011640 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:45195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260812 11:11:46.047856 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 22000
I20260812 11:11:46.068460 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 21427
I20260812 11:11:46.069779 21521 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:11:46.181572 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 21427
2026-08-12T11:11:46Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4664 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:11:46 dist-test-slave-rmhg krb5kdc[22306](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:11:46 dist-test-slave-rmhg krb5kdc[22306](info): set up 2 sockets
Aug 12 11:11:46 dist-test-slave-rmhg krb5kdc[22306](info): commencing operation
krb5kdc: starting...
W20260812 11:11:47.451505 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.003s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:11:47 dist-test-slave-rmhg krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533107, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:11:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:11:47Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.4.26.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.4.26.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.4.26.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/rangeradmin_127.4.26.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.4.26.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/rangeradmin_127.4.26.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.4.26.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.4.26.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.4.26.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/rangerlookup_127.4.26.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.4.26.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/rangerlookup_127.4.26.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.4.26.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.4.26.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.4.26.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/HTTP_127.4.26.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.4.26.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/HTTP_127.4.26.84@KRBTEST.COM.keytab.
I20260812 11:11:47.861783 4201 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskpQKIib/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/postgres -l logfile start
2026-08-12 11:11:50.416 UTC [22359] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 11:11:50.416 UTC [22359] LOG: listening on IPv4 address "127.4.26.84", port 36403
2026-08-12 11:11:50.419 UTC [22359] LOG: listening on Unix socket "/tmp/.s.PGSQL.36403"
2026-08-12 11:11:50.441 UTC [22361] LOG: database system was shut down at 2026-08-12 11:11:48 UTC
2026-08-12 11:11:50.445 UTC [22359] LOG: database system is ready to accept connections
I20260812 11:11:51.569909 4201 mini_postgres.cc:96] Postgres bound to 36403
2026-08-12 11:11:51.592 UTC [22373] FATAL: database "slave" does not exist
127.4.26.84:36403 - accepting connections
I20260812 11:11:51.593281 4201 mini_ranger.cc:161] Starting Ranger...
I20260812 11:11:51.626258 4201 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 11:11:52.151456 4201 mini_ranger.cc:87] Created ranger Postgres database
I20260812 11:11:52.151584 4201 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-admin
2026-08-12 11:11:52,451 [I] DB FLAVOR :POSTGRES
2026-08-12 11:11:52,452 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 11:11:52,452 [I] Checking connection..
2026-08-12 11:11:52,452 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 11:11:52,732 [I] Checking connection passed.
2026-08-12 11:11:52,732 [I] --------- Verifying version history table ---------
2026-08-12 11:11:52,733 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:11:52,991 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 11:11:52,992 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:11:53,264 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 11:11:53,265 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 11:11:53,265 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 11:11:53.512 UTC [22474] WARNING: there is no transaction in progress
2026-08-12 11:11:53,522 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 11:11:53,522 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:11:53,803 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 11:11:53,803 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 11:11:53,803 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 11:11:54,061 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 11:11:54,336 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-rmhg.c.gcp-upstream.internal','N') ;"
2026-08-12 11:11:54,592 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 11:11:54,857 [I] Table x_portal_user does not exist in database ranger
2026-08-12 11:11:54,857 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 11:11:55,132 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 11:11:55,133 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 11:11:55,380 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 11:11:55,666 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 11:11:55,666 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 11:11:56.669 UTC [22667] WARNING: there is no transaction in progress
2026-08-12 11:11:56.686 UTC [22667] WARNING: there is no transaction in progress
2026-08-12 11:11:56.703 UTC [22667] WARNING: there is no transaction in progress
2026-08-12 11:11:56.719 UTC [22667] WARNING: there is no transaction in progress
2026-08-12 11:11:56.736 UTC [22667] WARNING: there is no transaction in progress
2026-08-12 11:11:56.757 UTC [22667] WARNING: there is no transaction in progress
2026-08-12 11:11:56.822 UTC [22667] WARNING: there is no transaction in progress
2026-08-12 11:11:56.829 UTC [22667] WARNING: there is no transaction in progress
2026-08-12 11:11:56.844 UTC [22667] WARNING: there is no transaction in progress
2026-08-12 11:11:56.855 UTC [22667] WARNING: there is no transaction in progress
2026-08-12 11:11:56.865 UTC [22667] WARNING: there is no transaction in progress
2026-08-12 11:11:56.881 UTC [22667] WARNING: there is no transaction in progress
2026-08-12 11:11:56.891 UTC [22667] WARNING: there is no transaction in progress
2026-08-12 11:11:56.898 UTC [22667] WARNING: there is no transaction in progress
2026-08-12 11:11:56.906 UTC [22667] WARNING: there is no transaction in progress
2026-08-12 11:11:56.913 UTC [22667] WARNING: there is no transaction in progress
2026-08-12 11:11:57,610 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 11:11:57,610 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 11:11:57,865 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 11:11:57,866 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 11:11:58,142 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 11:11:58,142 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 11:11:58,418 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 11:11:58,418 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 11:11:58,690 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 11:11:58,952 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-rmhg.c.gcp-upstream.internal';"
2026-08-12 11:11:59,194 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 11:11:59,194 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 11:11:59,468 [I] DB_PATCHES have already been applied
I20260812 11:11:59.474259 4201 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-admin:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskpQKIib/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 11:11:59.474359 4201 mini_ranger.cc:193] Using host: 127.4.26.84
I20260812 11:11:59.493881 4201 mini_ranger.cc:227] Ranger admin URL: http://127.4.26.84:37513
Aug 12, 2026 11:11:59 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 11:11:59 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 11:11:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 11:11:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 11:11:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 11:12:00 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 11:12:00 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 11:12:00.791254 4201 mini_ranger.cc:160] Time spent starting Ranger: real 9.198s user 0.006s sys 0.056s
Aug 12, 2026 11:12:22 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 11:12:22 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 11:12:22 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 11:12:22 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 11:12:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 11:12:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 11:12:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 11:12:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 11:12:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 11:12:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 11:12:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 11:12:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 11:12:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 11:12:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 11:12:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 11:12:22 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 11:12:22 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 11:12:23 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 11:12:23.771581 4201 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.4.26.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.4.26.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.4.26.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/rangerkms_127.4.26.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.4.26.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/rangerkms_127.4.26.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.4.26.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.4.26.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.4.26.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/HTTP_127.4.26.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.4.26.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/HTTP_127.4.26.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 11:12:23 dist-test-slave-rmhg krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533143, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 11:12:23.969821 4201 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 11:12:23.996694 4201 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 11:12:24.825879 4201 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 11:12:24.826043 4201 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-kms
I20260812 11:12:24.826162 4201 mini_ranger_kms.cc:227] Using postgres at 127.4.26.84:36403
2026-08-12 11:12:25,271 [I] DB FLAVOR :POSTGRES
2026-08-12 11:12:25,272 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 11:12:25,272 [I] Checking connection
2026-08-12 11:12:25,272 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 11:12:25,534 [I] connection success
2026-08-12 11:12:25,535 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 11:12:25,535 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 11:12:25,535 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 11:12:25,795 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 11:12:25,795 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 11:12:25,795 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 11:12:25,796 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:36403/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 11:12:26,090 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 11:12:26.638494 4201 mini_ranger_kms.cc:310] Created kms service
I20260812 11:12:26.812551 4201 mini_ranger_kms.cc:326] Created kudu user
I20260812 11:12:26.856932 4201 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 11:12:26 dist-test-slave-rmhg krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533143, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:12:27.286604 4201 mini_ranger_kms.cc:384] Added ranger policy
I20260812 11:12:27.287076 4201 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-kms:/tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 11:12:27.287142 4201 mini_ranger_kms.cc:240] Using host: 127.4.26.84
I20260812 11:12:27.310207 4201 mini_ranger_kms.cc:276] Ranger KMS PID: 22995
I20260812 11:12:27.310436 4201 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.4.26.84:53409
Aug 12, 2026 11:12:28 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 11:12:28 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 11:12:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 11:12:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 11:12:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 11:12:28 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 11:12:29 dist-test-slave-rmhg krb5kdc[22306](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786533149, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.26.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 12 11:12:29 dist-test-slave-rmhg krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533149, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.26.84@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:12:30.007786 4201 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.038s user 0.097s sys 0.392s
I20260812 11:12:30.008183 4201 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 11:12:30.008419 4201 mini_ranger_kms.cc:401] 127.4.26.84:53409/kms/v1/keys
Aug 12 11:12:30 dist-test-slave-rmhg krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533149, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.26.84@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
Aug 12 11:12:32 dist-test-slave-rmhg krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:12:32.649791 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:34807
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:46703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:34807
--ranger_config_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.26.84:53409/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:12:33.118507 23077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:12:33.118887 23077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:12:33.119025 23077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:12:33.126791 23077 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:12:33.126969 23077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:12:33.127051 23077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:12:33.127135 23077 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:12:33.127203 23077 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:12:33.139438 23077 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:46703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/wal
--ranger_kms_url=127.4.26.84:53409/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:34807
--ranger_config_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:34807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:12:33.140905 23077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:12:33.142355 23077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:12:33.155932 23088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:12:33.155965 23091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:12:33.156009 23087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:12:33.156818 23077 server_base.cc:1034] running on GCE node
I20260812 11:12:33.157703 23077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:12:33.159283 23077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:12:33.160502 23077 hybrid_clock.cc:648] HybridClock initialized: now 1786533153160445 us; error 53 us; skew 500 ppm
I20260812 11:12:33.161031 23077 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:12:33 dist-test-slave-rmhg krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533153, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:12:33.169114 23077 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:12:33.171030 23077 webserver.cc:460] Webserver started at http://127.4.26.126:42537/ using document root <none> and password file <none>
I20260812 11:12:33.171772 23077 fs_manager.cc:359] Metadata directory not provided
I20260812 11:12:33.171885 23077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:12:33.172227 23077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:12:33 dist-test-slave-rmhg krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533153, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:12:33.236833 23077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "cf68bc9e14e64317a5bb8d874cb643e6"
format_stamp: "Formatted at 2026-08-12 11:12:33 on dist-test-slave-rmhg"
server_key: "337733135f1dbb3965e31689e12a73dd"
server_key_iv: "963459ea0452fd2b616759c281761383"
server_key_version: "kuduclusterkey@0"
I20260812 11:12:33.237948 23077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "cf68bc9e14e64317a5bb8d874cb643e6"
format_stamp: "Formatted at 2026-08-12 11:12:33 on dist-test-slave-rmhg"
server_key: "337733135f1dbb3965e31689e12a73dd"
server_key_iv: "963459ea0452fd2b616759c281761383"
server_key_version: "kuduclusterkey@0"
I20260812 11:12:33.243964 23077 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260812 11:12:33.263947 23103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:12:33.265563 23077 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:12:33.265744 23077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "cf68bc9e14e64317a5bb8d874cb643e6"
format_stamp: "Formatted at 2026-08-12 11:12:33 on dist-test-slave-rmhg"
server_key: "337733135f1dbb3965e31689e12a73dd"
server_key_iv: "963459ea0452fd2b616759c281761383"
server_key_version: "kuduclusterkey@0"
I20260812 11:12:33.265944 23077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:12:33.286700 23077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:12:33.291126 23077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:12:33.291415 23077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:12:33.327358 23077 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:34807
I20260812 11:12:33.327513 23189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:34807 every 8 connection(s)
I20260812 11:12:33.329711 23077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:12:33.335668 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 23077
I20260812 11:12:33.335992 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:12:33.337195 4201 external_mini_cluster.cc:1428] Setting key 195d1939753791134fc93ca3cb0059f7
I20260812 11:12:33.337950 23191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 11:12:33 dist-test-slave-rmhg krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:12:33.360014 23191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6: Bootstrap starting.
I20260812 11:12:33.366246 23191 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6: Neither blocks nor log segments found. Creating new log.
I20260812 11:12:33.368759 23191 log.cc:824] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6: Log is configured to *not* fsync() on all Append() calls
I20260812 11:12:33.370389 23194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:33.340072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47126 (local address 127.4.26.126:34807)
0812 11:12:33.341758 (+ 1686us) server_negotiation.cc:206] Beginning negotiation
0812 11:12:33.341772 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:12:33.341860 (+ 88us) server_negotiation.cc:407] Connection header received
0812 11:12:33.345868 (+ 4008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:12:33.345908 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:12:33.346700 (+ 792us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:12:33.347246 (+ 546us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:12:33.348973 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:33.351407 (+ 2434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:33.352994 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:33.354212 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:33.354502 (+ 290us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:33.359381 (+ 4879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:12:33.359393 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:12:33.359415 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:12:33.359469 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:12:33.364611 (+ 5142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:12:33.365677 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:12:33.365686 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:12:33.365693 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:12:33.365896 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:12:33.366422 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:12:33.366428 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:12:33.366430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:12:33.367206 (+ 776us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:12:33.367456 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0812 11:12:33.368145 (+ 689us) server_negotiation.cc:299] Negotiation successful
0812 11:12:33.368568 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1393,"thread_start_us":980,"threads_started":1}
I20260812 11:12:33.374323 23191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6: No bootstrap required, opened a new log
I20260812 11:12:33.387313 23191 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf68bc9e14e64317a5bb8d874cb643e6" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34807 } }
I20260812 11:12:33.388033 23191 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:12:33.388288 23191 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf68bc9e14e64317a5bb8d874cb643e6, State: Initialized, Role: FOLLOWER
I20260812 11:12:33.389292 23191 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf68bc9e14e64317a5bb8d874cb643e6" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34807 } }
I20260812 11:12:33.389770 23191 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:12:33.390002 23191 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:12:33.390236 23191 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:12:33.394145 23191 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf68bc9e14e64317a5bb8d874cb643e6" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34807 } }
I20260812 11:12:33.394984 23191 leader_election.cc:302] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf68bc9e14e64317a5bb8d874cb643e6; no voters:
I20260812 11:12:33.396282 23191 leader_election.cc:288] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:12:33.396433 23196 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:12:33.399749 23191 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:12:33.400556 23196 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [term 1 LEADER]: Becoming Leader. State: Replica: cf68bc9e14e64317a5bb8d874cb643e6, State: Running, Role: LEADER
I20260812 11:12:33.401433 23196 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf68bc9e14e64317a5bb8d874cb643e6" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34807 } }
I20260812 11:12:33.405778 23199 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf68bc9e14e64317a5bb8d874cb643e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf68bc9e14e64317a5bb8d874cb643e6" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34807 } } }
I20260812 11:12:33.406374 23199 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [sys.catalog]: This master's current role is: LEADER
I20260812 11:12:33.407310 23200 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf68bc9e14e64317a5bb8d874cb643e6. Latest consensus state: current_term: 1 leader_uuid: "cf68bc9e14e64317a5bb8d874cb643e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf68bc9e14e64317a5bb8d874cb643e6" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34807 } } }
I20260812 11:12:33.408051 23200 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6 [sys.catalog]: This master's current role is: LEADER
I20260812 11:12:33.411561 23211 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:12:33.421515 23211 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:12:33.422435 23191 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 11:12:33.449190 23211 catalog_manager.cc:1347] Generated new cluster ID: b5a6a4d9ae284f4fab0c228994f13801
I20260812 11:12:33.449429 23211 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:12:33.480916 23211 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:12:33.483556 23211 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:12:33.505400 23211 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6: Generated new TSK 0
I20260812 11:12:33.506961 23211 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:12:34.383380 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.26.84:53409/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:34807
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:46703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:12:34 dist-test-slave-rmhg krb5kdc[22306](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786533154, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 11:12:35.048741 23261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:12:35.049326 23261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:12:35.049590 23261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:12:35.064908 23261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:12:35.065181 23261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:12:35.065477 23261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:12:35.087155 23261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:46703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.4.26.84:53409/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:34807
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:12:35.089512 23261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:12:35.091827 23261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:12:35.117740 23280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:12:35.117909 23281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:12:35.130069 23284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:12:35.130910 23261 server_base.cc:1034] running on GCE node
I20260812 11:12:35.132324 23261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:12:35.145876 23261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:12:35.147342 23261 hybrid_clock.cc:648] HybridClock initialized: now 1786533155147088 us; error 134 us; skew 500 ppm
I20260812 11:12:35.148058 23261 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:12:35 dist-test-slave-rmhg krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533155, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:12:35.154681 23261 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:12:35.161334 23261 webserver.cc:460] Webserver started at http://127.4.26.65:35821/ using document root <none> and password file <none>
I20260812 11:12:35.162457 23261 fs_manager.cc:359] Metadata directory not provided
I20260812 11:12:35.162652 23261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:12:35.163200 23261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:12:35 dist-test-slave-rmhg krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533155, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:12:35.187561 23261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "5e27c3b0b34f48038e2de0be5f601299"
format_stamp: "Formatted at 2026-08-12 11:12:35 on dist-test-slave-rmhg"
server_key: "a4af3b3135230be8eb31bcf72169ecae"
server_key_iv: "721fd79b000f0d0ac8f641d9a21a4d3a"
server_key_version: "kuduclusterkey@0"
I20260812 11:12:35.189049 23261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "5e27c3b0b34f48038e2de0be5f601299"
format_stamp: "Formatted at 2026-08-12 11:12:35 on dist-test-slave-rmhg"
server_key: "a4af3b3135230be8eb31bcf72169ecae"
server_key_iv: "721fd79b000f0d0ac8f641d9a21a4d3a"
server_key_version: "kuduclusterkey@0"
I20260812 11:12:35.207724 23261 fs_manager.cc:691] Time spent creating directory manager: real 0.018s user 0.012s sys 0.003s
I20260812 11:12:35.240528 23293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:12:35.242949 23261 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.005s sys 0.001s
I20260812 11:12:35.243324 23261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "5e27c3b0b34f48038e2de0be5f601299"
format_stamp: "Formatted at 2026-08-12 11:12:35 on dist-test-slave-rmhg"
server_key: "a4af3b3135230be8eb31bcf72169ecae"
server_key_iv: "721fd79b000f0d0ac8f641d9a21a4d3a"
server_key_version: "kuduclusterkey@0"
I20260812 11:12:35.243780 23261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:12:35.277130 23261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:12:35.284490 23261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:12:35.284953 23261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:12:35.287070 23261 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:12:35.289768 23261 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:12:35.289906 23261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:12:35.290098 23261 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:12:35.290235 23261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:12:35 dist-test-slave-rmhg krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533154, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:12:35.538343 23261 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:46353
I20260812 11:12:35.538375 23477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:46353 every 8 connection(s)
I20260812 11:12:35.539849 23261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:12:35.549187 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 23261
I20260812 11:12:35.549424 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:12:35.550272 4201 external_mini_cluster.cc:1428] Setting key 8e85111b1f0921c2c11b96dd0b43c684
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
Aug 12 11:12:35 dist-test-slave-rmhg krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533155, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:12:35.606086 23483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:35.545252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:33825 (local address 127.4.26.126:34807)
0812 11:12:35.570103 (+ 24851us) server_negotiation.cc:206] Beginning negotiation
0812 11:12:35.570111 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:12:35.573251 (+ 3140us) server_negotiation.cc:407] Connection header received
0812 11:12:35.576933 (+ 3682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:12:35.576941 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:12:35.577050 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:12:35.577139 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:12:35.580497 (+ 3358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:35.582071 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:35.586059 (+ 3988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:35.586930 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:35.587069 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:35.596597 (+ 9528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:12:35.596604 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:12:35.596607 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:12:35.596667 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:12:35.601609 (+ 4942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:12:35.602925 (+ 1316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:12:35.602930 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:12:35.602932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:12:35.603201 (+ 269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:12:35.603853 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:12:35.603859 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:12:35.603862 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:12:35.604268 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:12:35.604409 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0812 11:12:35.605400 (+ 991us) server_negotiation.cc:299] Negotiation successful
0812 11:12:35.605660 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24669,"thread_start_us":29651,"threads_started":1}
I20260812 11:12:35.607636 23481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:35.544469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:34807 (local address 127.4.26.65:33825)
0812 11:12:35.571577 (+ 27108us) negotiation.cc:107] Waiting for socket to connect
0812 11:12:35.571651 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0812 11:12:35.576008 (+ 4357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:12:35.577975 (+ 1967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:12:35.577991 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:12:35.578859 (+ 868us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:12:35.580083 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:12:35.580122 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:12:35.582403 (+ 2281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:12:35.582410 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:12:35.585804 (+ 3394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:12:35.585829 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:12:35.587716 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:12:35.587730 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:12:35.588254 (+ 524us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:35.589549 (+ 1295us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:12:35.589589 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:12:35.596162 (+ 6573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:12:35.601865 (+ 5703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:12:35.601878 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:12:35.601901 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:12:35.602768 (+ 867us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:12:35.603345 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:12:35.603349 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:12:35.603351 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:12:35.603708 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:12:35.604423 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:12:35.604447 (+ 24us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:12:35.604873 (+ 426us) client_negotiation.cc:769] Sending connection context
0812 11:12:35.605141 (+ 268us) client_negotiation.cc:240] Negotiation successful
0812 11:12:35.605911 (+ 770us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26580,"thread_start_us":29336,"threads_started":1}
I20260812 11:12:35.614282 23478 heartbeater.cc:347] Connected to a master server at 127.4.26.126:34807
I20260812 11:12:35.614755 23478 heartbeater.cc:464] Registering TS with master...
I20260812 11:12:35.615953 23478 heartbeater.cc:511] Master 127.4.26.126:34807 requested a full tablet report, sending...
I20260812 11:12:35.619091 23130 ts_manager.cc:194] Registered new tserver with Master: 5e27c3b0b34f48038e2de0be5f601299 (127.4.26.65:46353)
I20260812 11:12:35.621738 23130 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:33825
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:12:35.638974 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.26.84:53409/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:34807
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:46703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:12:35 dist-test-slave-rmhg krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533154, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
W20260812 11:12:36.515069 23486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:12:36.515528 23486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:12:36.515785 23486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:12:36.528163 23486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:12:36.528447 23486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:12:36.528735 23486 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:12:36.547575 23486 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:46703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.4.26.84:53409/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:34807
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:12:36.549388 23486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:12:36.551091 23486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:12:36.572854 23507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:12:36.573623 23513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:12:36.574265 23508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:12:36.575955 23486 server_base.cc:1034] running on GCE node
I20260812 11:12:36.576658 23486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:12:36.577886 23486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:12:36.579253 23486 hybrid_clock.cc:648] HybridClock initialized: now 1786533156579093 us; error 55 us; skew 500 ppm
I20260812 11:12:36.579833 23486 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:12:36 dist-test-slave-rmhg krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533156, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:12:36.585532 23486 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:12:36.588359 23486 webserver.cc:460] Webserver started at http://127.4.26.66:39577/ using document root <none> and password file <none>
I20260812 11:12:36.589468 23486 fs_manager.cc:359] Metadata directory not provided
I20260812 11:12:36.589715 23486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:12:36.590226 23486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:12:36 dist-test-slave-rmhg krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533156, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:12:36.608481 23486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "f2f4fd9fea4c40ca9b8a4b10fec8f172"
format_stamp: "Formatted at 2026-08-12 11:12:36 on dist-test-slave-rmhg"
server_key: "3109de1b6cf77521e8365504a12e4127"
server_key_iv: "5bdb925e37a85d5ba5bfb9f3694f0f11"
server_key_version: "kuduclusterkey@0"
I20260812 11:12:36.609805 23486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "f2f4fd9fea4c40ca9b8a4b10fec8f172"
format_stamp: "Formatted at 2026-08-12 11:12:36 on dist-test-slave-rmhg"
server_key: "3109de1b6cf77521e8365504a12e4127"
server_key_iv: "5bdb925e37a85d5ba5bfb9f3694f0f11"
server_key_version: "kuduclusterkey@0"
I20260812 11:12:36.618724 23486 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.002s sys 0.006s
I20260812 11:12:36.633908 23478 heartbeater.cc:503] Master 127.4.26.126:34807 was elected leader, sending a full tablet report...
I20260812 11:12:36.638454 23527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:12:36.640394 23486 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.003s
I20260812 11:12:36.640662 23486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "f2f4fd9fea4c40ca9b8a4b10fec8f172"
format_stamp: "Formatted at 2026-08-12 11:12:36 on dist-test-slave-rmhg"
server_key: "3109de1b6cf77521e8365504a12e4127"
server_key_iv: "5bdb925e37a85d5ba5bfb9f3694f0f11"
server_key_version: "kuduclusterkey@0"
I20260812 11:12:36.641021 23486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:12:36.660199 23486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:12:36.665822 23486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:12:36.666203 23486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:12:36.667974 23486 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:12:36.670094 23486 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:12:36.670265 23486 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:12:36.670476 23486 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:12:36.670617 23486 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:12:36.770835 23486 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:41973
I20260812 11:12:36.770996 23723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:41973 every 8 connection(s)
I20260812 11:12:36.772361 23486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:12:36.778509 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 23486
I20260812 11:12:36.778712 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:12:36.779333 4201 external_mini_cluster.cc:1428] Setting key 1b23f43146dd5f0bc21c7f2e8b046b0d
Aug 12 11:12:36 dist-test-slave-rmhg krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533156, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:12:36.800042 23728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:36.775822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:53447 (local address 127.4.26.126:34807)
0812 11:12:36.776864 (+ 1042us) server_negotiation.cc:206] Beginning negotiation
0812 11:12:36.776871 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:12:36.777716 (+ 845us) server_negotiation.cc:407] Connection header received
0812 11:12:36.780598 (+ 2882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:12:36.780605 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:12:36.780745 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:12:36.780866 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:12:36.783285 (+ 2419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:36.784545 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:36.786949 (+ 2404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:36.787445 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:36.787582 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:36.791906 (+ 4324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:12:36.791912 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:12:36.791916 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:12:36.791955 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:12:36.795665 (+ 3710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:12:36.796626 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:12:36.796632 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:12:36.796635 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:12:36.796855 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:12:36.797463 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:12:36.797469 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:12:36.797472 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:12:36.798028 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:12:36.798249 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0812 11:12:36.799279 (+ 1030us) server_negotiation.cc:299] Negotiation successful
0812 11:12:36.799586 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":868,"thread_start_us":658,"threads_started":1}
I20260812 11:12:36.801115 23729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:36.776302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:34807 (local address 127.4.26.66:53447)
0812 11:12:36.777520 (+ 1218us) negotiation.cc:107] Waiting for socket to connect
0812 11:12:36.777563 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:12:36.780218 (+ 2655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:12:36.781175 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:12:36.781190 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:12:36.781902 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:12:36.783002 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:12:36.783035 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:12:36.784759 (+ 1724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:12:36.784765 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:12:36.786769 (+ 2004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:12:36.786785 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:12:36.787741 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:12:36.787750 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:12:36.788058 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:36.788845 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:12:36.788872 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:12:36.791576 (+ 2704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:12:36.795862 (+ 4286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:12:36.795870 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:12:36.795888 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:12:36.796461 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:12:36.796992 (+ 531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:12:36.796996 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:12:36.796998 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:12:36.797324 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:12:36.798204 (+ 880us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:12:36.798211 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:12:36.798694 (+ 483us) client_negotiation.cc:769] Sending connection context
0812 11:12:36.799090 (+ 396us) client_negotiation.cc:240] Negotiation successful
0812 11:12:36.799643 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"thread_start_us":488,"threads_started":1}
I20260812 11:12:36.803207 23726 heartbeater.cc:347] Connected to a master server at 127.4.26.126:34807
I20260812 11:12:36.803629 23726 heartbeater.cc:464] Registering TS with master...
I20260812 11:12:36.804859 23726 heartbeater.cc:511] Master 127.4.26.126:34807 requested a full tablet report, sending...
I20260812 11:12:36.806962 23130 ts_manager.cc:194] Registered new tserver with Master: f2f4fd9fea4c40ca9b8a4b10fec8f172 (127.4.26.66:41973)
I20260812 11:12:36.808034 23130 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:53447
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:12:36.846949 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.26.84:53409/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:34807
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:46703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:12:37.356963 23732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:12:37.357354 23732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:12:37.357544 23732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:12:37.366374 23732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:12:37.366550 23732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:12:37.366777 23732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:12:37.378827 23732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:46703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.4.26.84:53409/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:34807
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:12:37.380419 23732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:12:37.381969 23732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:12:37.398175 23750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:12:37.398090 23753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:12:37.398850 23747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:12:37.400007 23732 server_base.cc:1034] running on GCE node
I20260812 11:12:37.400758 23732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:12:37.401912 23732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:12:37.403146 23732 hybrid_clock.cc:648] HybridClock initialized: now 1786533157403070 us; error 46 us; skew 500 ppm
I20260812 11:12:37.403517 23732 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:12:37 dist-test-slave-rmhg krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533157, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:12:37.407357 23732 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:12:37.409283 23732 webserver.cc:460] Webserver started at http://127.4.26.67:45345/ using document root <none> and password file <none>
I20260812 11:12:37.410298 23732 fs_manager.cc:359] Metadata directory not provided
I20260812 11:12:37.410490 23732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:12:37.410943 23732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:12:37 dist-test-slave-rmhg krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533157, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:12:37.430186 23732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "5084af2297be4d3f9832675e69c8a7cf"
format_stamp: "Formatted at 2026-08-12 11:12:37 on dist-test-slave-rmhg"
server_key: "5fcc0b85cc10ca6e8be7193417807f7d"
server_key_iv: "35f803122f038653e6b40fec119bee42"
server_key_version: "kuduclusterkey@0"
I20260812 11:12:37.431598 23732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "5084af2297be4d3f9832675e69c8a7cf"
format_stamp: "Formatted at 2026-08-12 11:12:37 on dist-test-slave-rmhg"
server_key: "5fcc0b85cc10ca6e8be7193417807f7d"
server_key_iv: "35f803122f038653e6b40fec119bee42"
server_key_version: "kuduclusterkey@0"
I20260812 11:12:37.439620 23732 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260812 11:12:37.458088 23761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:12:37.459790 23732 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:12:37.460026 23732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "5084af2297be4d3f9832675e69c8a7cf"
format_stamp: "Formatted at 2026-08-12 11:12:37 on dist-test-slave-rmhg"
server_key: "5fcc0b85cc10ca6e8be7193417807f7d"
server_key_iv: "35f803122f038653e6b40fec119bee42"
server_key_version: "kuduclusterkey@0"
I20260812 11:12:37.460295 23732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:12:37.488121 23732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:12:37.492782 23732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:12:37.493252 23732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:12:37.494575 23732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:12:37.496412 23732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:12:37.496512 23732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:12:37.496697 23732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:12:37.496809 23732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:12:37.545758 23732 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:38907
I20260812 11:12:37.545832 23956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:38907 every 8 connection(s)
I20260812 11:12:37.547382 23732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:12:37.549145 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 23732
I20260812 11:12:37.549365 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:12:37.549834 4201 external_mini_cluster.cc:1428] Setting key 75e621afe63ae044a1cd331e3daa5557
Aug 12 11:12:37 dist-test-slave-rmhg krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533157, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:12:37.579026 23960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:37.550503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:57265 (local address 127.4.26.126:34807)
0812 11:12:37.551269 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0812 11:12:37.551276 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:12:37.552786 (+ 1510us) server_negotiation.cc:407] Connection header received
0812 11:12:37.556031 (+ 3245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:12:37.556037 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:12:37.556131 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:12:37.556231 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:12:37.558698 (+ 2467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.559830 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.562461 (+ 2631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.563267 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.563394 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:37.569604 (+ 6210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:12:37.569612 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:12:37.569617 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:12:37.569665 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:12:37.574553 (+ 4888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:12:37.575612 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:12:37.575617 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:12:37.575620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:12:37.575830 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:12:37.576546 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:12:37.576551 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:12:37.576553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:12:37.576996 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:12:37.577192 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0812 11:12:37.578177 (+ 985us) server_negotiation.cc:299] Negotiation successful
0812 11:12:37.578508 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":420,"threads_started":1}
I20260812 11:12:37.580415 23961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:37.551375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:34807 (local address 127.4.26.67:57265)
0812 11:12:37.552613 (+ 1238us) negotiation.cc:107] Waiting for socket to connect
0812 11:12:37.552680 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0812 11:12:37.555704 (+ 3024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:12:37.556561 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:12:37.556571 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:12:37.557444 (+ 873us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:12:37.558488 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:12:37.558512 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.560025 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.560029 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:12:37.562249 (+ 2220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:12:37.562265 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.563701 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.563712 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:12:37.564137 (+ 425us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:37.565436 (+ 1299us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:12:37.565466 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:12:37.569273 (+ 3807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:12:37.574736 (+ 5463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:12:37.574747 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:12:37.574765 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:12:37.575457 (+ 692us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:12:37.575937 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:12:37.575941 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:12:37.575943 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:12:37.576398 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:12:37.577141 (+ 743us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:12:37.577189 (+ 48us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:12:37.577611 (+ 422us) client_negotiation.cc:769] Sending connection context
0812 11:12:37.577996 (+ 385us) client_negotiation.cc:240] Negotiation successful
0812 11:12:37.578609 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":947,"thread_start_us":620,"threads_started":1}
I20260812 11:12:37.582445 23957 heartbeater.cc:347] Connected to a master server at 127.4.26.126:34807
I20260812 11:12:37.582919 23957 heartbeater.cc:464] Registering TS with master...
I20260812 11:12:37.584263 23957 heartbeater.cc:511] Master 127.4.26.126:34807 requested a full tablet report, sending...
I20260812 11:12:37.586372 23130 ts_manager.cc:194] Registered new tserver with Master: 5084af2297be4d3f9832675e69c8a7cf (127.4.26.67:38907)
I20260812 11:12:37.587450 23130 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:57265
I20260812 11:12:37.592298 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:12:37.614564 23960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:37.599668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47130 (local address 127.4.26.126:34807)
0812 11:12:37.599924 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 11:12:37.599932 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:12:37.601262 (+ 1330us) server_negotiation.cc:407] Connection header received
0812 11:12:37.601433 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:12:37.601436 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:12:37.601571 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:12:37.601665 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:12:37.603287 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.604148 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.605750 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.606261 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.606369 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:37.608923 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:12:37.608928 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:12:37.608932 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:12:37.608968 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:12:37.611918 (+ 2950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:12:37.612705 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:12:37.612710 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:12:37.612713 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:12:37.612871 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:12:37.613284 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:12:37.613288 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:12:37.613290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:12:37.613581 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:12:37.613874 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0812 11:12:37.614113 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 11:12:37.614331 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260812 11:12:37.619160 23130 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47130:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:12:37.626632 23130 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:12:37.678084 23997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:37.644163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:41973 (local address 127.0.0.1:58124)
0812 11:12:37.660178 (+ 16015us) negotiation.cc:107] Waiting for socket to connect
0812 11:12:37.660207 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0812 11:12:37.660445 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:12:37.666649 (+ 6204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:12:37.666659 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:12:37.666706 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:12:37.667429 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:12:37.667445 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.670070 (+ 2625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.670085 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:12:37.674179 (+ 4094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:12:37.674194 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.676793 (+ 2599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.676803 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:12:37.677049 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:37.677116 (+ 67us) client_negotiation.cc:769] Sending connection context
0812 11:12:37.677303 (+ 187us) client_negotiation.cc:240] Negotiation successful
0812 11:12:37.677554 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15761,"thread_start_us":24713,"threads_started":1}
I20260812 11:12:37.679066 23996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:37.645228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58124 (local address 127.4.26.66:41973)
0812 11:12:37.665135 (+ 19907us) server_negotiation.cc:206] Beginning negotiation
0812 11:12:37.665169 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0812 11:12:37.665229 (+ 60us) server_negotiation.cc:407] Connection header received
0812 11:12:37.665369 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:12:37.665379 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:12:37.665843 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:12:37.666190 (+ 347us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:12:37.667755 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.669802 (+ 2047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.674382 (+ 4580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.676035 (+ 1653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.676167 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:37.676440 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0812 11:12:37.678452 (+ 2012us) server_negotiation.cc:299] Negotiation successful
0812 11:12:37.678647 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19692,"thread_start_us":19504,"threads_started":1}
I20260812 11:12:37.680401 23993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:37.644334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44340 (local address 127.4.26.65:46353)
0812 11:12:37.668698 (+ 24364us) server_negotiation.cc:206] Beginning negotiation
0812 11:12:37.668708 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:12:37.668747 (+ 39us) server_negotiation.cc:407] Connection header received
0812 11:12:37.668865 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:12:37.668875 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:12:37.669665 (+ 790us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:12:37.669940 (+ 275us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:12:37.671744 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.674129 (+ 2385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.676561 (+ 2432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.677981 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.678130 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:37.679691 (+ 1561us) server_negotiation.cc:1035] Waiting for connection context
0812 11:12:37.679773 (+ 82us) server_negotiation.cc:299] Negotiation successful
0812 11:12:37.679931 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24156,"thread_start_us":23855,"threads_started":1}
I20260812 11:12:37.680460 23985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:37.643535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:46353 (local address 127.0.0.1:44340)
0812 11:12:37.647607 (+ 4072us) negotiation.cc:107] Waiting for socket to connect
0812 11:12:37.647658 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 11:12:37.647924 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:12:37.670263 (+ 22339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:12:37.670268 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:12:37.670297 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:12:37.671471 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:12:37.671485 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.674350 (+ 2865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.674355 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:12:37.676372 (+ 2017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:12:37.676387 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.678781 (+ 2394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.678789 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:12:37.678995 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:37.679030 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 11:12:37.679116 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 11:12:37.679272 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3734,"mutex_wait_us":20,"thread_start_us":3428,"threads_started":1}
I20260812 11:12:37.680859 23998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:37.650328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59168 (local address 127.4.26.67:38907)
0812 11:12:37.667681 (+ 17353us) server_negotiation.cc:206] Beginning negotiation
0812 11:12:37.667692 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:12:37.669939 (+ 2247us) server_negotiation.cc:407] Connection header received
0812 11:12:37.670060 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:12:37.670068 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:12:37.670386 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:12:37.670653 (+ 267us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:12:37.672659 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.674367 (+ 1708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.677525 (+ 3158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.679282 (+ 1757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.679416 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:37.679696 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0812 11:12:37.680087 (+ 391us) server_negotiation.cc:299] Negotiation successful
0812 11:12:37.680288 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17066,"thread_start_us":17384,"threads_started":1}
I20260812 11:12:37.681635 23992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:37.648604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:38907 (local address 127.0.0.1:59168)
0812 11:12:37.669474 (+ 20870us) negotiation.cc:107] Waiting for socket to connect
0812 11:12:37.669497 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:12:37.669798 (+ 301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:12:37.670648 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:12:37.670652 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:12:37.670679 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:12:37.672314 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:12:37.672329 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.674585 (+ 2256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.674590 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:12:37.677341 (+ 2751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:12:37.677354 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.679653 (+ 2299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.679662 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:12:37.679880 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:37.679914 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:12:37.680001 (+ 87us) client_negotiation.cc:240] Negotiation successful
0812 11:12:37.680154 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20633,"mutex_wait_us":22,"thread_start_us":11954,"threads_started":1}
I20260812 11:12:37.685079 23608 tablet_service.cc:1467] Processing CreateTablet for tablet 0d74374a0b914dd0af65fa12121d86f0 (DEFAULT_TABLE table=test-table [id=f543304af35f49faa678f311c3f2071e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:12:37.685075 23372 tablet_service.cc:1467] Processing CreateTablet for tablet 0d74374a0b914dd0af65fa12121d86f0 (DEFAULT_TABLE table=test-table [id=f543304af35f49faa678f311c3f2071e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:12:37.685601 23840 tablet_service.cc:1467] Processing CreateTablet for tablet 0d74374a0b914dd0af65fa12121d86f0 (DEFAULT_TABLE table=test-table [id=f543304af35f49faa678f311c3f2071e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:12:37.686898 23608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d74374a0b914dd0af65fa12121d86f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:12:37.686950 23372 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d74374a0b914dd0af65fa12121d86f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:12:37.687093 23840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d74374a0b914dd0af65fa12121d86f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:12:37.702183 23999 tablet_bootstrap.cc:492] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299: Bootstrap starting.
I20260812 11:12:37.704644 24002 tablet_bootstrap.cc:492] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf: Bootstrap starting.
I20260812 11:12:37.708024 23999 tablet_bootstrap.cc:654] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299: Neither blocks nor log segments found. Creating new log.
I20260812 11:12:37.708308 24000 tablet_bootstrap.cc:492] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172: Bootstrap starting.
I20260812 11:12:37.709474 24002 tablet_bootstrap.cc:654] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf: Neither blocks nor log segments found. Creating new log.
I20260812 11:12:37.711064 23999 log.cc:824] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299: Log is configured to *not* fsync() on all Append() calls
I20260812 11:12:37.711042 24002 log.cc:824] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf: Log is configured to *not* fsync() on all Append() calls
I20260812 11:12:37.712050 24000 tablet_bootstrap.cc:654] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172: Neither blocks nor log segments found. Creating new log.
I20260812 11:12:37.713781 24000 log.cc:824] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172: Log is configured to *not* fsync() on all Append() calls
I20260812 11:12:37.715764 24002 tablet_bootstrap.cc:492] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf: No bootstrap required, opened a new log
I20260812 11:12:37.716144 24002 ts_tablet_manager.cc:1397] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260812 11:12:37.716926 23999 tablet_bootstrap.cc:492] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299: No bootstrap required, opened a new log
I20260812 11:12:37.717314 23999 ts_tablet_manager.cc:1397] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.006s
I20260812 11:12:37.718243 24000 tablet_bootstrap.cc:492] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172: No bootstrap required, opened a new log
I20260812 11:12:37.718531 24000 ts_tablet_manager.cc:1397] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260812 11:12:37.728039 24000 raft_consensus.cc:348] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e27c3b0b34f48038e2de0be5f601299" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 46353 } } peers { permanent_uuid: "f2f4fd9fea4c40ca9b8a4b10fec8f172" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41973 } } peers { permanent_uuid: "5084af2297be4d3f9832675e69c8a7cf" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38907 } }
I20260812 11:12:37.728521 24000 raft_consensus.cc:374] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:12:37.728660 24000 raft_consensus.cc:729] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2f4fd9fea4c40ca9b8a4b10fec8f172, State: Initialized, Role: FOLLOWER
I20260812 11:12:37.729387 24000 consensus_queue.cc:260] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e27c3b0b34f48038e2de0be5f601299" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 46353 } } peers { permanent_uuid: "f2f4fd9fea4c40ca9b8a4b10fec8f172" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41973 } } peers { permanent_uuid: "5084af2297be4d3f9832675e69c8a7cf" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38907 } }
I20260812 11:12:37.729242 24002 raft_consensus.cc:348] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e27c3b0b34f48038e2de0be5f601299" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 46353 } } peers { permanent_uuid: "f2f4fd9fea4c40ca9b8a4b10fec8f172" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41973 } } peers { permanent_uuid: "5084af2297be4d3f9832675e69c8a7cf" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38907 } }
I20260812 11:12:37.729775 24002 raft_consensus.cc:374] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:12:37.729923 24002 raft_consensus.cc:729] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5084af2297be4d3f9832675e69c8a7cf, State: Initialized, Role: FOLLOWER
I20260812 11:12:37.730998 23726 heartbeater.cc:503] Master 127.4.26.126:34807 was elected leader, sending a full tablet report...
I20260812 11:12:37.730846 24002 consensus_queue.cc:260] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e27c3b0b34f48038e2de0be5f601299" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 46353 } } peers { permanent_uuid: "f2f4fd9fea4c40ca9b8a4b10fec8f172" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41973 } } peers { permanent_uuid: "5084af2297be4d3f9832675e69c8a7cf" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38907 } }
I20260812 11:12:37.730346 23999 raft_consensus.cc:348] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e27c3b0b34f48038e2de0be5f601299" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 46353 } } peers { permanent_uuid: "f2f4fd9fea4c40ca9b8a4b10fec8f172" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41973 } } peers { permanent_uuid: "5084af2297be4d3f9832675e69c8a7cf" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38907 } }
I20260812 11:12:37.731578 23999 raft_consensus.cc:374] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:12:37.731702 24000 ts_tablet_manager.cc:1428] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172: Time spent starting tablet: real 0.013s user 0.010s sys 0.003s
I20260812 11:12:37.731832 23999 raft_consensus.cc:729] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e27c3b0b34f48038e2de0be5f601299, State: Initialized, Role: FOLLOWER
I20260812 11:12:37.733070 23957 heartbeater.cc:503] Master 127.4.26.126:34807 was elected leader, sending a full tablet report...
I20260812 11:12:37.732762 23999 consensus_queue.cc:260] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e27c3b0b34f48038e2de0be5f601299" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 46353 } } peers { permanent_uuid: "f2f4fd9fea4c40ca9b8a4b10fec8f172" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41973 } } peers { permanent_uuid: "5084af2297be4d3f9832675e69c8a7cf" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38907 } }
I20260812 11:12:37.734038 24002 ts_tablet_manager.cc:1428] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf: Time spent starting tablet: real 0.018s user 0.015s sys 0.005s
I20260812 11:12:37.737257 23999 ts_tablet_manager.cc:1428] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299: Time spent starting tablet: real 0.020s user 0.014s sys 0.003s
I20260812 11:12:37.761389 24011 raft_consensus.cc:482] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:12:37.761811 24011 raft_consensus.cc:504] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e27c3b0b34f48038e2de0be5f601299" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 46353 } } peers { permanent_uuid: "f2f4fd9fea4c40ca9b8a4b10fec8f172" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41973 } } peers { permanent_uuid: "5084af2297be4d3f9832675e69c8a7cf" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38907 } }
I20260812 11:12:37.763846 24011 leader_election.cc:288] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2f4fd9fea4c40ca9b8a4b10fec8f172 (127.4.26.66:41973), 5084af2297be4d3f9832675e69c8a7cf (127.4.26.67:38907)
I20260812 11:12:37.773331 23998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:37.764362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:35041 (local address 127.4.26.67:38907)
0812 11:12:37.764642 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0812 11:12:37.764649 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:12:37.766582 (+ 1933us) server_negotiation.cc:407] Connection header received
0812 11:12:37.766815 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:12:37.766819 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:12:37.766881 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:12:37.766956 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:12:37.767675 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.768451 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.770911 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.772208 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.772288 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:37.772377 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0812 11:12:37.772896 (+ 519us) server_negotiation.cc:299] Negotiation successful
0812 11:12:37.773031 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260812 11:12:37.774129 23996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:37.764567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:41177 (local address 127.4.26.66:41973)
0812 11:12:37.764857 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0812 11:12:37.764863 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:12:37.766014 (+ 1151us) server_negotiation.cc:407] Connection header received
0812 11:12:37.766266 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:12:37.766270 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:12:37.766332 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:12:37.766409 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:12:37.767224 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.768043 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.771191 (+ 3148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.772693 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.772828 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:37.772918 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0812 11:12:37.773631 (+ 713us) server_negotiation.cc:299] Negotiation successful
0812 11:12:37.773774 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260812 11:12:37.774555 24014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:37.764908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:38907 (local address 127.4.26.65:35041)
0812 11:12:37.766339 (+ 1431us) negotiation.cc:107] Waiting for socket to connect
0812 11:12:37.766353 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0812 11:12:37.766676 (+ 323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:12:37.766997 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:12:37.767002 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:12:37.767028 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:12:37.767493 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:12:37.767502 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.768601 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.768605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:12:37.770681 (+ 2076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:12:37.770701 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.772570 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.772575 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:12:37.772722 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:37.772745 (+ 23us) client_negotiation.cc:769] Sending connection context
0812 11:12:37.772831 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 11:12:37.773000 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1318,"mutex_wait_us":1,"spinlock_wait_cycles":4992,"thread_start_us":1065,"threads_started":1}
I20260812 11:12:37.775074 24013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:37.764801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:41973 (local address 127.4.26.65:41177)
0812 11:12:37.765880 (+ 1079us) negotiation.cc:107] Waiting for socket to connect
0812 11:12:37.765896 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:12:37.766093 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:12:37.766455 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:12:37.766460 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:12:37.766488 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:12:37.767072 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:12:37.767087 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.768193 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.768200 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:12:37.770963 (+ 2763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:12:37.770980 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.773230 (+ 2250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.773238 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:12:37.773446 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:37.773481 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 11:12:37.774396 (+ 915us) client_negotiation.cc:240] Negotiation successful
0812 11:12:37.774561 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":951,"mutex_wait_us":5,"thread_start_us":701,"threads_started":1}
W20260812 11:12:37.775837 23727 tablet.cc:2369] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:12:37.775966 23877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d74374a0b914dd0af65fa12121d86f0" candidate_uuid: "5e27c3b0b34f48038e2de0be5f601299" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5084af2297be4d3f9832675e69c8a7cf" is_pre_election: true
I20260812 11:12:37.776746 23877 raft_consensus.cc:2454] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e27c3b0b34f48038e2de0be5f601299 in term 0.
I20260812 11:12:37.776639 23652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d74374a0b914dd0af65fa12121d86f0" candidate_uuid: "5e27c3b0b34f48038e2de0be5f601299" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2f4fd9fea4c40ca9b8a4b10fec8f172" is_pre_election: true
I20260812 11:12:37.777413 23652 raft_consensus.cc:2454] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e27c3b0b34f48038e2de0be5f601299 in term 0.
I20260812 11:12:37.777753 23296 leader_election.cc:302] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5084af2297be4d3f9832675e69c8a7cf, 5e27c3b0b34f48038e2de0be5f601299; no voters:
I20260812 11:12:37.778357 24011 raft_consensus.cc:2781] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:12:37.778548 24011 raft_consensus.cc:482] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:12:37.778673 24011 raft_consensus.cc:3037] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:12:37.781718 24011 raft_consensus.cc:504] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e27c3b0b34f48038e2de0be5f601299" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 46353 } } peers { permanent_uuid: "f2f4fd9fea4c40ca9b8a4b10fec8f172" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41973 } } peers { permanent_uuid: "5084af2297be4d3f9832675e69c8a7cf" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38907 } }
I20260812 11:12:37.782516 24011 leader_election.cc:288] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [CANDIDATE]: Term 1 election: Requested vote from peers f2f4fd9fea4c40ca9b8a4b10fec8f172 (127.4.26.66:41973), 5084af2297be4d3f9832675e69c8a7cf (127.4.26.67:38907)
I20260812 11:12:37.783113 23652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d74374a0b914dd0af65fa12121d86f0" candidate_uuid: "5e27c3b0b34f48038e2de0be5f601299" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2f4fd9fea4c40ca9b8a4b10fec8f172"
I20260812 11:12:37.783349 23877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d74374a0b914dd0af65fa12121d86f0" candidate_uuid: "5e27c3b0b34f48038e2de0be5f601299" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5084af2297be4d3f9832675e69c8a7cf"
I20260812 11:12:37.783447 23652 raft_consensus.cc:3037] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:12:37.783710 23877 raft_consensus.cc:3037] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:12:37.787935 23652 raft_consensus.cc:2454] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e27c3b0b34f48038e2de0be5f601299 in term 1.
I20260812 11:12:37.788074 23877 raft_consensus.cc:2454] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e27c3b0b34f48038e2de0be5f601299 in term 1.
I20260812 11:12:37.788784 23296 leader_election.cc:302] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5084af2297be4d3f9832675e69c8a7cf, 5e27c3b0b34f48038e2de0be5f601299, f2f4fd9fea4c40ca9b8a4b10fec8f172; no voters:
I20260812 11:12:37.789381 24011 raft_consensus.cc:2781] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:12:37.790205 24011 raft_consensus.cc:686] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [term 1 LEADER]: Becoming Leader. State: Replica: 5e27c3b0b34f48038e2de0be5f601299, State: Running, Role: LEADER
I20260812 11:12:37.790849 24011 consensus_queue.cc:237] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e27c3b0b34f48038e2de0be5f601299" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 46353 } } peers { permanent_uuid: "f2f4fd9fea4c40ca9b8a4b10fec8f172" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41973 } } peers { permanent_uuid: "5084af2297be4d3f9832675e69c8a7cf" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38907 } }
I20260812 11:12:37.796867 23128 catalog_manager.cc:5495] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e27c3b0b34f48038e2de0be5f601299 (127.4.26.65). New cstate: current_term: 1 leader_uuid: "5e27c3b0b34f48038e2de0be5f601299" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e27c3b0b34f48038e2de0be5f601299" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 46353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2f4fd9fea4c40ca9b8a4b10fec8f172" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5084af2297be4d3f9832675e69c8a7cf" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38907 } health_report { overall_health: UNKNOWN } } }
W20260812 11:12:37.799541 23958 tablet.cc:2369] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:12:37.799794 23479 tablet.cc:2369] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:12:37.841560 23993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:37.835361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44352 (local address 127.4.26.65:46353)
0812 11:12:37.835531 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0812 11:12:37.835536 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:12:37.835618 (+ 82us) server_negotiation.cc:407] Connection header received
0812 11:12:37.835834 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:12:37.835837 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:12:37.835935 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:12:37.836116 (+ 181us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:12:37.836531 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.837476 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.839014 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.839555 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.839658 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:37.840251 (+ 593us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:12:37.840886 (+ 635us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:12:37.841009 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 11:12:37.841240 (+ 231us) server_negotiation.cc:299] Negotiation successful
0812 11:12:37.841323 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:12:37.851588 23652 raft_consensus.cc:1261] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172 [term 1 FOLLOWER]: Refusing update from remote peer 5e27c3b0b34f48038e2de0be5f601299: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:12:37.851666 23877 raft_consensus.cc:1261] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf [term 1 FOLLOWER]: Refusing update from remote peer 5e27c3b0b34f48038e2de0be5f601299: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:12:37.852689 24015 consensus_queue.cc:1035] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2f4fd9fea4c40ca9b8a4b10fec8f172" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:12:37.853124 24011 consensus_queue.cc:1035] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5084af2297be4d3f9832675e69c8a7cf" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:12:37.865877 24024 mvcc.cc:205] Tried to move back new op lower bound from 7317639814548811776 to 7317639814316154880. Current Snapshot: MvccSnapshot[applied={T|T < 7317639814548811776}]
I20260812 11:12:37.881969 23128 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:12:37.882316 23128 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:12:37.886445 23128 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cf68bc9e14e64317a5bb8d874cb643e6: Sending DeleteTablet for 3 replicas of tablet 0d74374a0b914dd0af65fa12121d86f0
I20260812 11:12:37.888154 23840 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d74374a0b914dd0af65fa12121d86f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:12:37 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:59168
I20260812 11:12:37.888162 23608 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d74374a0b914dd0af65fa12121d86f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:12:37 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:58124
I20260812 11:12:37.888279 23372 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d74374a0b914dd0af65fa12121d86f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:12:37 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:44340
I20260812 11:12:37.891053 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 23261
I20260812 11:12:37.898058 24048 tablet_replica.cc:330] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172: stopping tablet replica
I20260812 11:12:37.898729 24048 raft_consensus.cc:2229] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:12:37.899442 24048 raft_consensus.cc:2258] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:12:37.900575 24045 tablet_replica.cc:330] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf: stopping tablet replica
I20260812 11:12:37.901938 24045 raft_consensus.cc:2229] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:12:37.902100 24048 ts_tablet_manager.cc:1905] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:12:37.909271 24048 ts_tablet_manager.cc:1918] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:12:37.909834 24048 log.cc:1196] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/0d74374a0b914dd0af65fa12121d86f0
I20260812 11:12:37.910015 24045 raft_consensus.cc:2258] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:12:37.910459 24048 ts_tablet_manager.cc:1939] T 0d74374a0b914dd0af65fa12121d86f0 P f2f4fd9fea4c40ca9b8a4b10fec8f172: Deleting consensus metadata
I20260812 11:12:37.912705 23112 catalog_manager.cc:4841] TS f2f4fd9fea4c40ca9b8a4b10fec8f172 (127.4.26.66:41973): tablet 0d74374a0b914dd0af65fa12121d86f0 (table test-table [id=f543304af35f49faa678f311c3f2071e]) successfully deleted
I20260812 11:12:37.912925 24045 ts_tablet_manager.cc:1905] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 11:12:37 dist-test-slave-rmhg krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:12:37.912444 24049 tablet_replica.cc:330] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299: stopping tablet replica
I20260812 11:12:37.913980 24049 raft_consensus.cc:2229] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:12:37.917034 24049 raft_consensus.cc:2258] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:12:37.920800 24045 ts_tablet_manager.cc:1918] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:12:37.921032 24045 log.cc:1196] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/0d74374a0b914dd0af65fa12121d86f0
I20260812 11:12:37.921663 24045 ts_tablet_manager.cc:1939] T 0d74374a0b914dd0af65fa12121d86f0 P 5084af2297be4d3f9832675e69c8a7cf: Deleting consensus metadata
I20260812 11:12:37.922487 24049 ts_tablet_manager.cc:1905] T 0d74374a0b914dd0af65fa12121d86f0 P 5e27c3b0b34f48038e2de0be5f601299: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:12:37.923920 23106 catalog_manager.cc:4841] TS 5084af2297be4d3f9832675e69c8a7cf (127.4.26.67:38907): tablet 0d74374a0b914dd0af65fa12121d86f0 (table test-table [id=f543304af35f49faa678f311c3f2071e]) successfully deleted
I20260812 11:12:37.924054 23993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:37.892538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44358 (local address 127.4.26.65:46353)
0812 11:12:37.892772 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0812 11:12:37.892779 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:12:37.900543 (+ 7764us) server_negotiation.cc:407] Connection header received
0812 11:12:37.900896 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:12:37.900902 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:12:37.900994 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:12:37.901096 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:12:37.903263 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.904665 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.906762 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:37.907592 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:37.907708 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:37.914662 (+ 6954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:12:37.914680 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:12:37.914700 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:12:37.914756 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:12:37.919674 (+ 4918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:12:37.920793 (+ 1119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:12:37.920804 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:12:37.920807 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:12:37.921055 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:12:37.921652 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:12:37.921658 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:12:37.921661 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:12:37.922187 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:12:37.922559 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0812 11:12:37.923274 (+ 715us) server_negotiation.cc:299] Negotiation successful
0812 11:12:37.923592 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:12:37.925194 23468 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:12:38.025910 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 23261
W20260812 11:12:38.053434 23106 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.26.65:46353 (error 108)
I20260812 11:12:38.054216 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 23486
I20260812 11:12:38.055486 23992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:38.054966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:46353 (local address 127.0.0.1:44374)
0812 11:12:38.055159 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0812 11:12:38.055294 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:46353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 11:12:38.055742 23106 catalog_manager.cc:4584] TS 5e27c3b0b34f48038e2de0be5f601299 (127.4.26.65:46353): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0d74374a0b914dd0af65fa12121d86f0: Network error: Client connection negotiation failed: client connection to 127.4.26.65:46353: connect: Connection refused (error 111)
Aug 12 11:12:38 dist-test-slave-rmhg krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:12:38.070283 23996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:38.055039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58140 (local address 127.4.26.66:41973)
0812 11:12:38.055202 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 11:12:38.055208 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:12:38.055338 (+ 130us) server_negotiation.cc:407] Connection header received
0812 11:12:38.055491 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:12:38.055496 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:12:38.055587 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:12:38.055699 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:12:38.057095 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:38.057857 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:38.059154 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:38.059551 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:38.059668 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:38.064007 (+ 4339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:12:38.064023 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:12:38.064041 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:12:38.064079 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:12:38.067107 (+ 3028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:12:38.067902 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:12:38.067911 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:12:38.067913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:12:38.068067 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:12:38.068470 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:12:38.068476 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:12:38.068478 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:12:38.068892 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:12:38.069232 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0812 11:12:38.069590 (+ 358us) server_negotiation.cc:299] Negotiation successful
0812 11:12:38.069872 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:12:38.071244 23716 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:12:38.111080 23992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:38.110551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:46353 (local address 127.0.0.1:44384)
0812 11:12:38.110754 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0812 11:12:38.110872 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:46353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260812 11:12:38.112291 23992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:38.111859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:46353 (local address 127.0.0.1:44398)
0812 11:12:38.112021 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 11:12:38.112128 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:46353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 11:12:38.167193 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 23486
I20260812 11:12:38.175721 23992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:38.175152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:46353 (local address 127.0.0.1:44400)
0812 11:12:38.175379 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 11:12:38.175501 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:46353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260812 11:12:38.176890 23992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:38.176469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:46353 (local address 127.0.0.1:44412)
0812 11:12:38.176635 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 11:12:38.176731 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:46353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 11:12:38.190898 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 23732
Aug 12 11:12:38 dist-test-slave-rmhg krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:12:38.209230 23998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:38.191763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59182 (local address 127.4.26.67:38907)
0812 11:12:38.191932 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0812 11:12:38.191937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:12:38.191955 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:12:38.192035 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:12:38.192039 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:12:38.192106 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:12:38.192201 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:12:38.193528 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:38.194283 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:38.195624 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:12:38.196029 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:12:38.196124 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:12:38.203319 (+ 7195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:12:38.203337 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:12:38.203356 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:12:38.203399 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:12:38.206230 (+ 2831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:12:38.207100 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:12:38.207109 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:12:38.207112 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:12:38.207263 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:12:38.207670 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:12:38.207673 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:12:38.207675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:12:38.208080 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:12:38.208325 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0812 11:12:38.208677 (+ 352us) server_negotiation.cc:299] Negotiation successful
0812 11:12:38.208864 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:12:38.209923 23949 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:12:38.257978 23992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:38.257467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:46353 (local address 127.0.0.1:44424)
0812 11:12:38.257715 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0812 11:12:38.257807 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:46353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260812 11:12:38.259168 23992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:12:38.258768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:46353 (local address 127.0.0.1:44434)
0812 11:12:38.258959 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0812 11:12:38.259035 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:46353: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260812 11:12:38.301394 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 23732
I20260812 11:12:38.323932 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 23077
I20260812 11:12:38.325212 23183 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:12:38.444720 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 23077
I20260812 11:12:38.480935 4201 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 11:12:38.816740 4201 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 11:12:38.817073 4201 mini_ranger.cc:66] Stopping Ranger...
I20260812 11:12:39.163347 4201 mini_ranger.cc:68] Stopped Ranger
2026-08-12 11:12:39.163 UTC [22359] LOG: received smart shutdown request
2026-08-12 11:12:39.167 UTC [22359] LOG: background worker "logical replication launcher" (PID 22370) exited with exit code 1
2026-08-12 11:12:39.167 UTC [22363] LOG: shutting down
2026-08-12 11:12:39.343 UTC [22359] LOG: database system is shut down
2026-08-12T11:12:39Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (53264 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:12:39 dist-test-slave-rmhg krb5kdc[24071](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:12:39 dist-test-slave-rmhg krb5kdc[24071](info): set up 2 sockets
Aug 12 11:12:39 dist-test-slave-rmhg krb5kdc[24071](info): commencing operation
krb5kdc: starting...
W20260812 11:12:40.735786 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:12:40 dist-test-slave-rmhg krb5kdc[24071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533160, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:12:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:12:40Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.4.26.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.4.26.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.4.26.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/rangeradmin_127.4.26.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.4.26.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/rangeradmin_127.4.26.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.4.26.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.4.26.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.4.26.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/rangerlookup_127.4.26.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.4.26.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/rangerlookup_127.4.26.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.4.26.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.4.26.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.4.26.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/HTTP_127.4.26.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.4.26.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/HTTP_127.4.26.84@KRBTEST.COM.keytab.
I20260812 11:12:41.113930 4201 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskpQKIib/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/postgres -l logfile start
2026-08-12 11:12:43.512 UTC [24123] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-12 11:12:43.512 UTC [24123] LOG: listening on IPv4 address "127.4.26.84", port 46405
2026-08-12 11:12:43.515 UTC [24123] LOG: listening on Unix socket "/tmp/.s.PGSQL.46405"
2026-08-12 11:12:43.538 UTC [24128] LOG: database system was shut down at 2026-08-12 11:12:42 UTC
2026-08-12 11:12:43.542 UTC [24123] LOG: database system is ready to accept connections
I20260812 11:12:44.649600 4201 mini_postgres.cc:96] Postgres bound to 46405
2026-08-12 11:12:44.670 UTC [24143] FATAL: database "slave" does not exist
127.4.26.84:46405 - accepting connections
I20260812 11:12:44.671286 4201 mini_ranger.cc:161] Starting Ranger...
I20260812 11:12:44.701289 4201 mini_ranger.cc:84] Created miniranger Postgres user
I20260812 11:12:45.151310 4201 mini_ranger.cc:87] Created ranger Postgres database
I20260812 11:12:45.151432 4201 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-admin
2026-08-12 11:12:45,474 [I] DB FLAVOR :POSTGRES
2026-08-12 11:12:45,474 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 11:12:45,474 [I] Checking connection..
2026-08-12 11:12:45,474 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-12 11:12:45,734 [I] Checking connection passed.
2026-08-12 11:12:45,734 [I] --------- Verifying version history table ---------
2026-08-12 11:12:45,735 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:12:45,993 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 11:12:45,993 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:12:46,234 [I] Table x_db_version_h does not exist in database ranger
2026-08-12 11:12:46,234 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-12 11:12:46,234 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-12 11:12:46.489 UTC [24264] WARNING: there is no transaction in progress
2026-08-12 11:12:46,498 [I] create_dbversion_catalog.sql file imported successfully
2026-08-12 11:12:46,499 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-12 11:12:46,757 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-12 11:12:46,758 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 11:12:46,758 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-12 11:12:47,035 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-12 11:12:47,279 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-rmhg.c.gcp-upstream.internal','N') ;"
2026-08-12 11:12:47,541 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 11:12:47,808 [I] Table x_portal_user does not exist in database ranger
2026-08-12 11:12:47,808 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 11:12:48,075 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-12 11:12:48,075 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 11:12:48,324 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 11:12:48,568 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-12 11:12:48,568 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-12 11:12:49.566 UTC [24457] WARNING: there is no transaction in progress
2026-08-12 11:12:49.582 UTC [24457] WARNING: there is no transaction in progress
2026-08-12 11:12:49.599 UTC [24457] WARNING: there is no transaction in progress
2026-08-12 11:12:49.613 UTC [24457] WARNING: there is no transaction in progress
2026-08-12 11:12:49.629 UTC [24457] WARNING: there is no transaction in progress
2026-08-12 11:12:49.649 UTC [24457] WARNING: there is no transaction in progress
2026-08-12 11:12:49.718 UTC [24457] WARNING: there is no transaction in progress
2026-08-12 11:12:49.724 UTC [24457] WARNING: there is no transaction in progress
2026-08-12 11:12:49.738 UTC [24457] WARNING: there is no transaction in progress
2026-08-12 11:12:49.750 UTC [24457] WARNING: there is no transaction in progress
2026-08-12 11:12:49.760 UTC [24457] WARNING: there is no transaction in progress
2026-08-12 11:12:49.775 UTC [24457] WARNING: there is no transaction in progress
2026-08-12 11:12:49.786 UTC [24457] WARNING: there is no transaction in progress
2026-08-12 11:12:49.794 UTC [24457] WARNING: there is no transaction in progress
2026-08-12 11:12:49.801 UTC [24457] WARNING: there is no transaction in progress
2026-08-12 11:12:49.808 UTC [24457] WARNING: there is no transaction in progress
2026-08-12 11:12:50,443 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-12 11:12:50,443 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-12 11:12:50,706 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-12 11:12:50,706 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-12 11:12:50,971 [I] Table x_portal_user already exists in database 'ranger'
2026-08-12 11:12:50,971 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-12 11:12:51,249 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-12 11:12:51,249 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-12 11:12:51,501 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-12 11:12:51,768 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-rmhg.c.gcp-upstream.internal';"
2026-08-12 11:12:52,034 [I] CORE_DB_SCHEMA import status has been updated
2026-08-12 11:12:52,035 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-12 11:12:52,297 [I] DB_PATCHES have already been applied
I20260812 11:12:52.303709 4201 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-admin:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskpQKIib/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260812 11:12:52.303809 4201 mini_ranger.cc:193] Using host: 127.4.26.84
I20260812 11:12:52.323030 4201 mini_ranger.cc:227] Ranger admin URL: http://127.4.26.84:40053
Aug 12, 2026 11:12:52 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 11:12:52 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 11:12:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-admin/ews/webapp
Aug 12, 2026 11:12:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 12, 2026 11:12:52 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 12, 2026 11:12:53 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-admin/ews/webapp].
Aug 12, 2026 11:12:53 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260812 11:12:53.666441 4201 mini_ranger.cc:160] Time spent starting Ranger: real 8.995s user 0.001s sys 0.056s
Aug 12, 2026 11:13:14 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 12, 2026 11:13:14 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 12, 2026 11:13:14 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 12, 2026 11:13:14 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 12, 2026 11:13:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 12, 2026 11:13:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 12, 2026 11:13:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 12, 2026 11:13:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 12, 2026 11:13:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 12, 2026 11:13:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 12, 2026 11:13:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 12, 2026 11:13:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 12, 2026 11:13:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 12, 2026 11:13:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 12, 2026 11:13:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 12, 2026 11:13:14 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 12, 2026 11:13:14 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 12, 2026 11:13:15 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260812 11:13:16.347946 4201 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.4.26.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.4.26.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.4.26.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/rangerkms_127.4.26.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.4.26.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/rangerkms_127.4.26.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.4.26.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.4.26.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.4.26.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/HTTP_127.4.26.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.4.26.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/HTTP_127.4.26.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 12 11:13:16 dist-test-slave-rmhg krb5kdc[24071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533196, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260812 11:13:16.556335 4201 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260812 11:13:16.581065 4201 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260812 11:13:17.438356 4201 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260812 11:13:17.438473 4201 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-kms
I20260812 11:13:17.438512 4201 mini_ranger_kms.cc:227] Using postgres at 127.4.26.84:46405
2026-08-12 11:13:17,842 [I] DB FLAVOR :POSTGRES
2026-08-12 11:13:17,843 [I] --------- Verifying Ranger DB connection ---------
2026-08-12 11:13:17,843 [I] Checking connection
2026-08-12 11:13:17,843 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-12 11:13:18,091 [I] connection success
2026-08-12 11:13:18,091 [I] --------- Verifying Ranger DB tables ---------
2026-08-12 11:13:18,091 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-12 11:13:18,091 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-12 11:13:18,344 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-12 11:13:18,345 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-12 11:13:18,345 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-12 11:13:18,345 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.26.84:46405/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-12 11:13:18,637 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260812 11:13:19.164300 4201 mini_ranger_kms.cc:310] Created kms service
I20260812 11:13:19.419744 4201 mini_ranger_kms.cc:326] Created kudu user
I20260812 11:13:19.475466 4201 mini_ranger_kms.cc:343] Created rangerkms user
Aug 12 11:13:19 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533196, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:13:19.914765 4201 mini_ranger_kms.cc:384] Added ranger policy
I20260812 11:13:19.915112 4201 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-kms:/tmp/dist-test-taskpQKIib/build/asan/bin/postgresql.jar:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskpQKIib/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260812 11:13:19.915158 4201 mini_ranger_kms.cc:240] Using host: 127.4.26.84
I20260812 11:13:19.941321 4201 mini_ranger_kms.cc:276] Ranger KMS PID: 24752
I20260812 11:13:19.941452 4201 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.4.26.84:53501
Aug 12, 2026 11:13:20 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 12, 2026 11:13:20 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 12, 2026 11:13:20 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 12, 2026 11:13:20 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 12, 2026 11:13:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-kms/ews/webapp].
Aug 12, 2026 11:13:21 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 12 11:13:22 dist-test-slave-rmhg krb5kdc[24071](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786533202, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.26.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:22.473241 4201 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.917s user 0.065s sys 0.373s
I20260812 11:13:22.473501 4201 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260812 11:13:22.473698 4201 mini_ranger_kms.cc:401] 127.4.26.84:53501/kms/v1/keys
Aug 12 11:13:22 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533202, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.26.84@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
Aug 12 11:13:23 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533202, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.26.84@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
Aug 12 11:13:25 dist-test-slave-rmhg krb5kdc[24071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533205, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:13:25.436666 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37339
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:37339
--ranger_config_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.26.84:53501/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:13:25.792690 24840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:25.793036 24840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:25.793174 24840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:25.800799 24840 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:13:25.800937 24840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:25.800992 24840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:25.801044 24840 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:13:25.801116 24840 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:13:25.811920 24840 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/wal
--ranger_kms_url=127.4.26.84:53501/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:37339
--ranger_config_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:25.813427 24840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:25.814975 24840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:25.829218 24850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:25.829238 24849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:25.829525 24856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:25.831370 24840 server_base.cc:1034] running on GCE node
I20260812 11:13:25.832505 24840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:25.834643 24840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:25.835928 24840 hybrid_clock.cc:648] HybridClock initialized: now 1786533205835835 us; error 78 us; skew 500 ppm
I20260812 11:13:25.836421 24840 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:25 dist-test-slave-rmhg krb5kdc[24071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533205, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:25.845525 24840 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:13:25.847712 24840 webserver.cc:460] Webserver started at http://127.4.26.126:37931/ using document root <none> and password file <none>
I20260812 11:13:25.848735 24840 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:25.848906 24840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:25.849366 24840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:13:25 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533205, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:13:25.912676 24840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "5c5606d3e35448a5bdfafceee2247748"
format_stamp: "Formatted at 2026-08-12 11:13:25 on dist-test-slave-rmhg"
server_key: "a00e7fa0bb622f9eae3707f53735ded9"
server_key_iv: "5e77299291f1485f6441be09b44ba533"
server_key_version: "kuduclusterkey@0"
I20260812 11:13:25.913945 24840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "5c5606d3e35448a5bdfafceee2247748"
format_stamp: "Formatted at 2026-08-12 11:13:25 on dist-test-slave-rmhg"
server_key: "a00e7fa0bb622f9eae3707f53735ded9"
server_key_iv: "5e77299291f1485f6441be09b44ba533"
server_key_version: "kuduclusterkey@0"
I20260812 11:13:25.921514 24840 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260812 11:13:25.942142 24869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:25.943954 24840 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:13:25.944190 24840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "5c5606d3e35448a5bdfafceee2247748"
format_stamp: "Formatted at 2026-08-12 11:13:25 on dist-test-slave-rmhg"
server_key: "a00e7fa0bb622f9eae3707f53735ded9"
server_key_iv: "5e77299291f1485f6441be09b44ba533"
server_key_version: "kuduclusterkey@0"
I20260812 11:13:25.944484 24840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:25.972352 24840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:25.977871 24840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:25.978277 24840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:26.009060 24840 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:37339
I20260812 11:13:26.009066 24954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:37339 every 8 connection(s)
I20260812 11:13:26.010900 24840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:13:26.016976 24956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:13:26.020069 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 24840
I20260812 11:13:26.020284 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:13:26.020956 4201 external_mini_cluster.cc:1428] Setting key 8a24558a914805b4841d2ddf1d1ff4f3
I20260812 11:13:26.031646 24956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748: Bootstrap starting.
I20260812 11:13:26.035320 24956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748: Neither blocks nor log segments found. Creating new log.
I20260812 11:13:26.036599 24956 log.cc:824] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:13:26 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533205, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:13:26.040233 24956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748: No bootstrap required, opened a new log
I20260812 11:13:26.049947 24961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:26.023844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49434 (local address 127.4.26.126:37339)
0812 11:13:26.024689 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:26.024706 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:26.024760 (+ 54us) server_negotiation.cc:407] Connection header received
0812 11:13:26.027109 (+ 2349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:26.027143 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:26.027702 (+ 559us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:26.028182 (+ 480us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:26.030551 (+ 2369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:26.032737 (+ 2186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:26.034788 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:26.035901 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:26.036085 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:26.040935 (+ 4850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:26.040948 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:26.040973 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:26.041024 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:26.045286 (+ 4262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:26.046294 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:26.046302 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:26.046310 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:26.046486 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:26.046913 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:26.046916 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:26.046918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:26.047562 (+ 644us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:26.047863 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:26.048304 (+ 441us) server_negotiation.cc:299] Negotiation successful
0812 11:13:26.048733 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":327,"threads_started":1}
I20260812 11:13:26.050549 24956 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5606d3e35448a5bdfafceee2247748" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37339 } }
I20260812 11:13:26.050916 24956 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:13:26.051016 24956 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c5606d3e35448a5bdfafceee2247748, State: Initialized, Role: FOLLOWER
I20260812 11:13:26.051600 24956 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5606d3e35448a5bdfafceee2247748" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37339 } }
I20260812 11:13:26.051846 24956 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:13:26.051971 24956 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:13:26.052136 24956 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:13:26.054441 24956 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5606d3e35448a5bdfafceee2247748" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37339 } }
I20260812 11:13:26.054939 24956 leader_election.cc:302] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c5606d3e35448a5bdfafceee2247748; no voters:
I20260812 11:13:26.055501 24956 leader_election.cc:288] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:13:26.055647 24963 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:13:26.056281 24963 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 1 LEADER]: Becoming Leader. State: Replica: 5c5606d3e35448a5bdfafceee2247748, State: Running, Role: LEADER
I20260812 11:13:26.056846 24963 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5606d3e35448a5bdfafceee2247748" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37339 } }
I20260812 11:13:26.057523 24956 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:13:26.059366 24966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c5606d3e35448a5bdfafceee2247748" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5606d3e35448a5bdfafceee2247748" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37339 } } }
I20260812 11:13:26.059669 24966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [sys.catalog]: This master's current role is: LEADER
I20260812 11:13:26.060462 24970 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:13:26.060389 24967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c5606d3e35448a5bdfafceee2247748. Latest consensus state: current_term: 1 leader_uuid: "5c5606d3e35448a5bdfafceee2247748" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5606d3e35448a5bdfafceee2247748" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37339 } } }
I20260812 11:13:26.062115 24967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [sys.catalog]: This master's current role is: LEADER
I20260812 11:13:26.068763 24970 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:13:26.069516 24956 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260812 11:13:26.093865 24970 catalog_manager.cc:1347] Generated new cluster ID: 4622e52c334c497caea761aa5ee66e88
I20260812 11:13:26.094027 24970 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:13:26.111855 24970 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:13:26.114023 24970 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:13:26.130801 24970 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748: Generated new TSK 0
I20260812 11:13:26.132197 24970 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:13:26.844992 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.26.84:53501/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37339
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:13:27 dist-test-slave-rmhg krb5kdc[24071](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786533207, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260812 11:13:27.282711 25036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:27.283245 25036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:27.283450 25036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:27.295607 25036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:27.295890 25036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:27.296139 25036 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:13:27.312547 25036 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.4.26.84:53501/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:27.314769 25036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:27.316735 25036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:27.335427 25052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:27.336047 25053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:27.345291 25036 server_base.cc:1034] running on GCE node
W20260812 11:13:27.345695 25056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:27.346596 25036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:27.348021 25036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:27.349259 25036 hybrid_clock.cc:648] HybridClock initialized: now 1786533207349157 us; error 91 us; skew 500 ppm
I20260812 11:13:27.349676 25036 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:27 dist-test-slave-rmhg krb5kdc[24071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533207, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:27.354416 25036 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:13:27.366997 25036 webserver.cc:460] Webserver started at http://127.4.26.65:35397/ using document root <none> and password file <none>
I20260812 11:13:27.368186 25036 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:27.368381 25036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:27.368806 25036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:13:27 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533207, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:13:27.390471 25036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "12ad6910af094ed997b1b7cba3ffd4fa"
format_stamp: "Formatted at 2026-08-12 11:13:27 on dist-test-slave-rmhg"
server_key: "728aa28ec7aecd087a05a405896e8a72"
server_key_iv: "373fc9d0c929eaa77c1318045e95084c"
server_key_version: "kuduclusterkey@0"
I20260812 11:13:27.391692 25036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "12ad6910af094ed997b1b7cba3ffd4fa"
format_stamp: "Formatted at 2026-08-12 11:13:27 on dist-test-slave-rmhg"
server_key: "728aa28ec7aecd087a05a405896e8a72"
server_key_iv: "373fc9d0c929eaa77c1318045e95084c"
server_key_version: "kuduclusterkey@0"
I20260812 11:13:27.408105 25036 fs_manager.cc:691] Time spent creating directory manager: real 0.016s user 0.014s sys 0.000s
I20260812 11:13:27.429112 25069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:27.431171 25036 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260812 11:13:27.431376 25036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "12ad6910af094ed997b1b7cba3ffd4fa"
format_stamp: "Formatted at 2026-08-12 11:13:27 on dist-test-slave-rmhg"
server_key: "728aa28ec7aecd087a05a405896e8a72"
server_key_iv: "373fc9d0c929eaa77c1318045e95084c"
server_key_version: "kuduclusterkey@0"
I20260812 11:13:27.431649 25036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:27.490849 25036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:27.495780 25036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:27.496107 25036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:27.497259 25036 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:13:27.498907 25036 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:13:27.499073 25036 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 11:13:27.499274 25036 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:13:27.499399 25036 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:27.555807 25036 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:45599
I20260812 11:13:27.555807 25264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:45599 every 8 connection(s)
I20260812 11:13:27.557446 25036 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:13:27.563935 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 25036
I20260812 11:13:27.564190 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:13:27.565079 4201 external_mini_cluster.cc:1428] Setting key 58a088a4ed84e722502f8e2fa344a058
Aug 12 11:13:27 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533207, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
I20260812 11:13:27.619203 25269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:27.566032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:37905 (local address 127.4.26.126:37339)
0812 11:13:27.585747 (+ 19715us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:27.585755 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:27.587072 (+ 1317us) server_negotiation.cc:407] Connection header received
0812 11:13:27.589475 (+ 2403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:27.589481 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:27.589603 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:27.589710 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:27.592110 (+ 2400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:27.593278 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:27.603090 (+ 9812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:27.603741 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:27.603934 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:27.610392 (+ 6458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:27.610400 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:27.610405 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:27.610454 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:27.614366 (+ 3912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:27.615473 (+ 1107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:27.615480 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:27.615484 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:27.615679 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:27.616235 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:27.616241 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:27.616245 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:27.616649 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:27.616798 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:27.618512 (+ 1714us) server_negotiation.cc:299] Negotiation successful
0812 11:13:27.618780 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19532,"thread_start_us":19346,"threads_started":1}
I20260812 11:13:27.622761 25268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:27.562759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37339 (local address 127.4.26.65:37905)
0812 11:13:27.586409 (+ 23650us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:27.586470 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:27.588889 (+ 2419us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:27.590252 (+ 1363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:27.590268 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:27.590969 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:27.591876 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:27.591901 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:27.601352 (+ 9451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:27.601359 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:27.602844 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:27.602867 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:27.604192 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:27.604200 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:27.604548 (+ 348us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:27.605367 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:27.605402 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:27.610058 (+ 4656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:27.614585 (+ 4527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:27.614598 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:27.614621 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:27.615297 (+ 676us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:27.615811 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:27.615816 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:27.615820 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:27.616101 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:27.617506 (+ 1405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:27.617516 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:27.618015 (+ 499us) client_negotiation.cc:769] Sending connection context
0812 11:13:27.618365 (+ 350us) client_negotiation.cc:240] Negotiation successful
0812 11:13:27.618975 (+ 610us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23314,"thread_start_us":23034,"threads_started":1}
I20260812 11:13:27.625876 25265 heartbeater.cc:347] Connected to a master server at 127.4.26.126:37339
I20260812 11:13:27.626266 25265 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
I20260812 11:13:27.627694 25265 heartbeater.cc:511] Master 127.4.26.126:37339 requested a full tablet report, sending...
I20260812 11:13:27.630918 24899 ts_manager.cc:194] Registered new tserver with Master: 12ad6910af094ed997b1b7cba3ffd4fa (127.4.26.65:45599)
I20260812 11:13:27.632934 24899 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:37905
Aug 12 11:13:27 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533207, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
W20260812 11:13:27.670099 4201 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.4.26.66: real 0.100s user 0.000s sys 0.025s
I20260812 11:13:27.670876 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.26.84:53501/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37339
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:13:27 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533207, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
W20260812 11:13:28.250167 25273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:28.250603 25273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:28.250766 25273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:28.261715 25273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:28.261885 25273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:28.262070 25273 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:13:28.273015 25273 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.4.26.84:53501/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:28.274456 25273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:28.275846 25273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:28.290125 25297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:28.290033 25296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:28.290060 25302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:28.295109 25273 server_base.cc:1034] running on GCE node
I20260812 11:13:28.295854 25273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:28.296965 25273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:28.298169 25273 hybrid_clock.cc:648] HybridClock initialized: now 1786533208298122 us; error 87 us; skew 500 ppm
I20260812 11:13:28.298506 25273 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:28 dist-test-slave-rmhg krb5kdc[24071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533208, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:28.301795 25273 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:13:28.303404 25273 webserver.cc:460] Webserver started at http://127.4.26.66:37731/ using document root <none> and password file <none>
I20260812 11:13:28.304180 25273 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:28.304299 25273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:28.304637 25273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:13:28 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533208, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:13:28.318843 25273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "cd8cb261001c4d74bdaecd18c2dcb77b"
format_stamp: "Formatted at 2026-08-12 11:13:28 on dist-test-slave-rmhg"
server_key: "de91c43aae241e7f712f111452a96f2d"
server_key_iv: "0528ffa8d350a3bcd46f282091fbca95"
server_key_version: "kuduclusterkey@0"
I20260812 11:13:28.319738 25273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "cd8cb261001c4d74bdaecd18c2dcb77b"
format_stamp: "Formatted at 2026-08-12 11:13:28 on dist-test-slave-rmhg"
server_key: "de91c43aae241e7f712f111452a96f2d"
server_key_iv: "0528ffa8d350a3bcd46f282091fbca95"
server_key_version: "kuduclusterkey@0"
I20260812 11:13:28.325484 25273 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:13:28.343680 25314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:28.345341 25273 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:13:28.345530 25273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "cd8cb261001c4d74bdaecd18c2dcb77b"
format_stamp: "Formatted at 2026-08-12 11:13:28 on dist-test-slave-rmhg"
server_key: "de91c43aae241e7f712f111452a96f2d"
server_key_iv: "0528ffa8d350a3bcd46f282091fbca95"
server_key_version: "kuduclusterkey@0"
I20260812 11:13:28.345747 25273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:28.375025 25273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:28.380586 25273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:28.380976 25273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:28.382371 25273 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:13:28.384575 25273 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:13:28.384680 25273 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:28.384806 25273 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:13:28.384859 25273 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:28.423365 25273 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:41571
I20260812 11:13:28.423388 25514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:41571 every 8 connection(s)
I20260812 11:13:28.424765 25273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:13:28.434863 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 25273
I20260812 11:13:28.435073 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:13:28.435675 4201 external_mini_cluster.cc:1428] Setting key f4bbee10840e34555b053b3e78834507
Aug 12 11:13:28 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533208, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:13:28.447069 25518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:28.427885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:54383 (local address 127.4.26.126:37339)
0812 11:13:28.428393 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:28.428398 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:28.429627 (+ 1229us) server_negotiation.cc:407] Connection header received
0812 11:13:28.431668 (+ 2041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:28.431675 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:28.431785 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:28.431890 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:28.433611 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:28.434392 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:28.436224 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:28.436841 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:28.436978 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:28.440707 (+ 3729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:28.440712 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:28.440715 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:28.440752 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:28.443469 (+ 2717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:28.444373 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:28.444378 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:28.444380 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:28.444531 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:28.445022 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:28.445026 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:28.445028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:28.445383 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:28.445523 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:28.446334 (+ 811us) server_negotiation.cc:299] Negotiation successful
0812 11:13:28.446608 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":269,"threads_started":1}
I20260812 11:13:28.448148 25519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:28.428476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37339 (local address 127.4.26.66:54383)
0812 11:13:28.429417 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:28.429474 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:28.431318 (+ 1844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:28.432196 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:28.432206 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:28.432688 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:28.433412 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:28.433435 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:28.434566 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:28.434570 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:28.436065 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:28.436081 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:28.437123 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:28.437130 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:28.437494 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:28.438300 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:28.438328 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:28.440444 (+ 2116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:28.443696 (+ 3252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:28.443705 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:28.443722 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:28.444224 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:28.444648 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:28.444653 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:28.444657 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:28.444889 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:28.445523 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:28.445533 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:28.445916 (+ 383us) client_negotiation.cc:769] Sending connection context
0812 11:13:28.446201 (+ 285us) client_negotiation.cc:240] Negotiation successful
0812 11:13:28.446802 (+ 601us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":398,"threads_started":1}
I20260812 11:13:28.449805 25516 heartbeater.cc:347] Connected to a master server at 127.4.26.126:37339
I20260812 11:13:28.450213 25516 heartbeater.cc:464] Registering TS with master...
I20260812 11:13:28.451274 25516 heartbeater.cc:511] Master 127.4.26.126:37339 requested a full tablet report, sending...
I20260812 11:13:28.453251 24899 ts_manager.cc:194] Registered new tserver with Master: cd8cb261001c4d74bdaecd18c2dcb77b (127.4.26.66:41571)
I20260812 11:13:28.454388 24899 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:54383
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:13:28.498610 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.26.84:53501/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37339
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:13:28.637132 25265 heartbeater.cc:503] Master 127.4.26.126:37339 was elected leader, sending a full tablet report...
W20260812 11:13:28.854024 25523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:28.854403 25523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:28.854540 25523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:28.862171 25523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:28.862318 25523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:28.862493 25523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:13:28.872889 25523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.4.26.84:53501/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:37339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:28.874352 25523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:28.875797 25523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:28.890164 25535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:28.890118 25533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:28.890136 25538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:28.891099 25523 server_base.cc:1034] running on GCE node
I20260812 11:13:28.891811 25523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:28.892974 25523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:28.894219 25523 hybrid_clock.cc:648] HybridClock initialized: now 1786533208894174 us; error 78 us; skew 500 ppm
I20260812 11:13:28.894622 25523 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:28 dist-test-slave-rmhg krb5kdc[24071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533208, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:28.898085 25523 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:13:28.899747 25523 webserver.cc:460] Webserver started at http://127.4.26.67:43923/ using document root <none> and password file <none>
I20260812 11:13:28.900452 25523 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:28.900556 25523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:28.900844 25523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 12 11:13:28 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533208, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:13:28.918682 25523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "893bc43e458c4be89313f4611f1237f7"
format_stamp: "Formatted at 2026-08-12 11:13:28 on dist-test-slave-rmhg"
server_key: "129d1864cfcb153b01016dca4fcb53a5"
server_key_iv: "b9287d62cf9a9ee602d96103cb00bb5a"
server_key_version: "kuduclusterkey@0"
I20260812 11:13:28.919893 25523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "893bc43e458c4be89313f4611f1237f7"
format_stamp: "Formatted at 2026-08-12 11:13:28 on dist-test-slave-rmhg"
server_key: "129d1864cfcb153b01016dca4fcb53a5"
server_key_iv: "b9287d62cf9a9ee602d96103cb00bb5a"
server_key_version: "kuduclusterkey@0"
I20260812 11:13:28.926501 25523 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 11:13:28.942746 25546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:28.944351 25523 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:13:28.944561 25523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "893bc43e458c4be89313f4611f1237f7"
format_stamp: "Formatted at 2026-08-12 11:13:28 on dist-test-slave-rmhg"
server_key: "129d1864cfcb153b01016dca4fcb53a5"
server_key_iv: "b9287d62cf9a9ee602d96103cb00bb5a"
server_key_version: "kuduclusterkey@0"
I20260812 11:13:28.944901 25523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:28.965426 25523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:28.969811 25523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:28.970100 25523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:28.971122 25523 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:13:28.972659 25523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:13:28.972741 25523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:28.972836 25523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:13:28.972879 25523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:29.006856 25523 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:35981
I20260812 11:13:29.006891 25747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:35981 every 8 connection(s)
I20260812 11:13:29.008325 25523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:13:29.017657 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 25523
I20260812 11:13:29.017832 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:13:29.018302 4201 external_mini_cluster.cc:1428] Setting key 38b7324ee5e13f112b2b47e065e1798f
Aug 12 11:13:29 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533208, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:13:29.030485 25750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:29.011331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:33825 (local address 127.4.26.126:37339)
0812 11:13:29.011873 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:29.011877 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:29.012896 (+ 1019us) server_negotiation.cc:407] Connection header received
0812 11:13:29.014888 (+ 1992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:29.014894 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:29.015014 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:29.015124 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:29.016787 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:29.017658 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:29.019548 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:29.020065 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:29.020194 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:29.024238 (+ 4044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:29.024243 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:29.024247 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:29.024284 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:29.027183 (+ 2899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:29.028041 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:29.028046 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:29.028049 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:29.028202 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:29.028634 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:29.028638 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:29.028640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:29.028981 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:29.029198 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:29.029964 (+ 766us) server_negotiation.cc:299] Negotiation successful
0812 11:13:29.030170 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":311,"threads_started":1}
I20260812 11:13:29.031443 25751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:29.011883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37339 (local address 127.4.26.67:33825)
0812 11:13:29.012711 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:29.012768 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:29.014579 (+ 1811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:29.015409 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:29.015419 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:29.015892 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:29.016587 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:29.016609 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:29.017839 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:29.017844 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:29.019389 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:29.019404 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:29.020331 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:29.020340 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:29.020634 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:29.021661 (+ 1027us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:29.021686 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:29.023974 (+ 2288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:29.027330 (+ 3356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:29.027338 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:29.027354 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:29.027918 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:29.028290 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:29.028293 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:29.028296 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:29.028509 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:29.029133 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:29.029139 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:29.029536 (+ 397us) client_negotiation.cc:769] Sending connection context
0812 11:13:29.029831 (+ 295us) client_negotiation.cc:240] Negotiation successful
0812 11:13:29.030277 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":347,"threads_started":1}
I20260812 11:13:29.033144 25748 heartbeater.cc:347] Connected to a master server at 127.4.26.126:37339
I20260812 11:13:29.033555 25748 heartbeater.cc:464] Registering TS with master...
I20260812 11:13:29.034420 25748 heartbeater.cc:511] Master 127.4.26.126:37339 requested a full tablet report, sending...
I20260812 11:13:29.035917 24899 ts_manager.cc:194] Registered new tserver with Master: 893bc43e458c4be89313f4611f1237f7 (127.4.26.67:35981)
I20260812 11:13:29.036736 24899 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:33825
I20260812 11:13:29.047116 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:13:29.048840 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 25036
Aug 12 11:13:29 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533205, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:13:29.066634 25753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:29.050031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54016 (local address 127.4.26.65:45599)
0812 11:13:29.050735 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:29.050743 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:29.050770 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:13:29.050832 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:29.050839 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:29.051113 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:29.051264 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:29.052830 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:29.053934 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:29.055407 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:29.056000 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:29.056102 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:29.060662 (+ 4560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:29.060676 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:29.060694 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:29.060736 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:29.063740 (+ 3004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:29.064562 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:29.064571 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:29.064574 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:29.064738 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:29.065174 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:29.065179 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:29.065183 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:29.065561 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:29.065818 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:29.066122 (+ 304us) server_negotiation.cc:299] Negotiation successful
0812 11:13:29.066341 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":367,"threads_started":1}
I20260812 11:13:29.068004 25259 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:29.151332 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 25036
I20260812 11:13:29.172410 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 25273
Aug 12 11:13:29 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533205, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:13:29.194572 25756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:29.173542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60160 (local address 127.4.26.66:41571)
0812 11:13:29.174160 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:29.174168 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:29.174194 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:13:29.174257 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:29.174265 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:29.174472 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:29.174655 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:29.176029 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:29.177117 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:29.178649 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:29.179244 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:29.179353 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:29.188107 (+ 8754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:29.188128 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:29.188148 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:29.188199 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:29.191343 (+ 3144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:29.192232 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:29.192242 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:29.192244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:29.192411 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:29.192907 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:29.192912 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:29.192914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:29.193410 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:29.193713 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:29.194037 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 11:13:29.194278 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":373,"threads_started":1}
I20260812 11:13:29.196048 25509 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:29.282575 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 25273
I20260812 11:13:29.309612 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 25523
Aug 12 11:13:29 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533205, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:13:29.327314 25761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:29.310763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38768 (local address 127.4.26.67:35981)
0812 11:13:29.311442 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:29.311450 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:29.311485 (+ 35us) server_negotiation.cc:407] Connection header received
0812 11:13:29.311547 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:29.311553 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:29.311793 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:29.311950 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:29.313345 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:29.314392 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:29.315849 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:29.316459 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:29.316583 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:29.321325 (+ 4742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:29.321341 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:29.321358 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:29.321400 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:29.324210 (+ 2810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:29.324995 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:29.325003 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:29.325006 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:29.325144 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:29.325657 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:29.325663 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:29.325665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:29.326054 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:29.326383 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:29.326671 (+ 288us) server_negotiation.cc:299] Negotiation successful
0812 11:13:29.326953 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":353,"threads_started":1}
I20260812 11:13:29.328809 25742 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:29.413323 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 25523
I20260812 11:13:29.437104 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 24840
I20260812 11:13:29.438588 24946 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:29.547453 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 24840
I20260812 11:13:29.583058 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37339
--webserver_interface=127.4.26.126
--webserver_port=37931
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:37339
--ranger_config_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.26.84:53501/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.4.26.84:53501/kms with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:13:29.931159 25772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:29.931499 25772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:29.931592 25772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:29.939055 25772 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:13:29.939190 25772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:29.939236 25772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:29.939293 25772 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:13:29.939342 25772 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:13:29.949796 25772 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.4.26.84:53501/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:37339
--ranger_config_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=37931
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:29.951115 25772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:29.952457 25772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:29.964937 25782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:29.964906 25785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:29.965011 25783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:29.965690 25772 server_base.cc:1034] running on GCE node
I20260812 11:13:29.966523 25772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:29.968365 25772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:29.969641 25772 hybrid_clock.cc:648] HybridClock initialized: now 1786533209969556 us; error 75 us; skew 500 ppm
I20260812 11:13:29.970042 25772 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:29 dist-test-slave-rmhg krb5kdc[24071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533209, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:29.973337 25772 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:13:29.974958 25772 webserver.cc:460] Webserver started at http://127.4.26.126:37931/ using document root <none> and password file <none>
I20260812 11:13:29.975643 25772 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:29.975788 25772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 11:13:30 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533209, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:13:30.055565 25772 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:13:30.058959 25798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:30.060434 25772 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260812 11:13:30.060644 25772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "5c5606d3e35448a5bdfafceee2247748"
format_stamp: "Formatted at 2026-08-12 11:13:25 on dist-test-slave-rmhg"
server_key: "a00e7fa0bb622f9eae3707f53735ded9"
server_key_iv: "5e77299291f1485f6441be09b44ba533"
server_key_version: "kuduclusterkey@0"
I20260812 11:13:30.061774 25772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:30.076661 25772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:30.081523 25772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:30.081862 25772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:30.100205 25772 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:37339
I20260812 11:13:30.100227 25883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:37339 every 8 connection(s)
I20260812 11:13:30.101781 25772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:13:30.103428 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 25772
I20260812 11:13:30.104483 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.26.84:53501/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:45599
--local_ip_for_outbound_sockets=127.4.26.65
--tserver_master_addrs=127.4.26.126:37339
--webserver_port=35397
--webserver_interface=127.4.26.65
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.4.26.84:53501/kms with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:13:30.111433 25885 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:13:30.116025 25885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748: Bootstrap starting.
I20260812 11:13:30.135739 25885 log.cc:824] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:30.145407 25885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:13:30.146029 25885 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748: Bootstrap complete.
I20260812 11:13:30.155208 25885 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5606d3e35448a5bdfafceee2247748" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37339 } }
I20260812 11:13:30.156170 25885 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c5606d3e35448a5bdfafceee2247748, State: Initialized, Role: FOLLOWER
I20260812 11:13:30.156845 25885 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5606d3e35448a5bdfafceee2247748" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37339 } }
I20260812 11:13:30.157066 25885 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:13:30.157213 25885 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:13:30.157394 25885 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:13:30.161791 25885 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5606d3e35448a5bdfafceee2247748" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37339 } }
I20260812 11:13:30.162364 25885 leader_election.cc:302] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c5606d3e35448a5bdfafceee2247748; no voters:
I20260812 11:13:30.162997 25885 leader_election.cc:288] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 11:13:30.163239 25892 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:13:30.164362 25892 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [term 2 LEADER]: Becoming Leader. State: Replica: 5c5606d3e35448a5bdfafceee2247748, State: Running, Role: LEADER
I20260812 11:13:30.165139 25892 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5606d3e35448a5bdfafceee2247748" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37339 } }
I20260812 11:13:30.165561 25885 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:13:30.168175 25893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5c5606d3e35448a5bdfafceee2247748" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5606d3e35448a5bdfafceee2247748" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37339 } } }
I20260812 11:13:30.168326 25895 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c5606d3e35448a5bdfafceee2247748. Latest consensus state: current_term: 2 leader_uuid: "5c5606d3e35448a5bdfafceee2247748" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c5606d3e35448a5bdfafceee2247748" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37339 } } }
I20260812 11:13:30.168643 25893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [sys.catalog]: This master's current role is: LEADER
I20260812 11:13:30.168669 25895 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748 [sys.catalog]: This master's current role is: LEADER
I20260812 11:13:30.176580 25902 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:13:30.182796 25902 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:13:30.184276 25902 catalog_manager.cc:1259] Loaded cluster ID: 4622e52c334c497caea761aa5ee66e88
I20260812 11:13:30.184396 25902 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:13:30.188712 25902 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:13:30.190311 25902 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748: Loaded TSK: 0
I20260812 11:13:30.192013 25902 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:13:30.197319 25885 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260812 11:13:30.560456 25888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:30.560874 25888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:30.561043 25888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:30.572751 25888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:30.572916 25888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:30.573109 25888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:13:30.588977 25888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.4.26.84:53501/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:45599
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=35397
--tserver_master_addrs=127.4.26.126:37339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:30.590961 25888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:30.592955 25888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:30.621389 25947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:30.622531 25950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:30.626976 25954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:30.628724 25888 server_base.cc:1034] running on GCE node
I20260812 11:13:30.629614 25888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:30.632704 25888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:30.640264 25888 hybrid_clock.cc:648] HybridClock initialized: now 1786533210640050 us; error 184 us; skew 500 ppm
I20260812 11:13:30.640812 25888 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:30 dist-test-slave-rmhg krb5kdc[24071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533210, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:30.646142 25888 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:13:30.653646 25888 webserver.cc:460] Webserver started at http://127.4.26.65:35397/ using document root <none> and password file <none>
I20260812 11:13:30.654853 25888 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:30.655055 25888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 11:13:30 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533210, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:13:30.715350 25888 fs_manager.cc:709] Time spent opening directory manager: real 0.014s user 0.003s sys 0.004s
I20260812 11:13:30.719709 25969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:30.722078 25888 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.001s
I20260812 11:13:30.722298 25888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "12ad6910af094ed997b1b7cba3ffd4fa"
format_stamp: "Formatted at 2026-08-12 11:13:27 on dist-test-slave-rmhg"
server_key: "728aa28ec7aecd087a05a405896e8a72"
server_key_iv: "373fc9d0c929eaa77c1318045e95084c"
server_key_version: "kuduclusterkey@0"
I20260812 11:13:30.723750 25888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:30.773526 25888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:30.779429 25888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:30.779820 25888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:30.782882 25888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:13:30.784742 25888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:13:30.784849 25888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:30.784947 25888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:13:30.785023 25888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:30.853945 25888 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:45599
I20260812 11:13:30.854013 26163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:45599 every 8 connection(s)
I20260812 11:13:30.856119 25888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:13:30.866895 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 25888
I20260812 11:13:30.867791 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.26.84:53501/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:41571
--local_ip_for_outbound_sockets=127.4.26.66
--tserver_master_addrs=127.4.26.126:37339
--webserver_port=37731
--webserver_interface=127.4.26.66
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.4.26.84:53501/kms with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:13:30 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533210, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:13:30.916110 26167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:30.860017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37339 (local address 127.4.26.65:52465)
0812 11:13:30.883836 (+ 23819us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:30.883921 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:30.886423 (+ 2502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:30.888588 (+ 2165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:30.888600 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:30.889389 (+ 789us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:30.890292 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:30.890324 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:30.892753 (+ 2429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:30.892759 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:30.894996 (+ 2237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:30.895015 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:30.896656 (+ 1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:30.896665 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:30.896973 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:30.901191 (+ 4218us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:30.901247 (+ 56us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:30.904476 (+ 3229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:30.909952 (+ 5476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:30.909964 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:30.909986 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:30.910731 (+ 745us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:30.911438 (+ 707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:30.911443 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:30.911447 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:30.911797 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:30.913117 (+ 1320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:30.913127 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:30.913619 (+ 492us) client_negotiation.cc:769] Sending connection context
0812 11:13:30.913974 (+ 355us) client_negotiation.cc:240] Negotiation successful
0812 11:13:30.914666 (+ 692us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23389,"thread_start_us":23184,"threads_started":1}
I20260812 11:13:30.916106 26166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:30.859892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:52465 (local address 127.4.26.126:37339)
0812 11:13:30.884987 (+ 25095us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:30.885019 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:30.885080 (+ 61us) server_negotiation.cc:407] Connection header received
0812 11:13:30.887277 (+ 2197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:30.887308 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:30.887917 (+ 609us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:30.888341 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:30.890565 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:30.892517 (+ 1952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:30.895185 (+ 2668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:30.896354 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:30.896575 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:30.904930 (+ 8355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:30.904944 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:30.904973 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:30.905042 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:30.909661 (+ 4619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:30.910978 (+ 1317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:30.910990 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:30.911000 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:30.911260 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:30.911957 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:30.911962 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:30.911965 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:30.912775 (+ 810us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:30.913025 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:30.914321 (+ 1296us) server_negotiation.cc:299] Negotiation successful
0812 11:13:30.914786 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24771,"thread_start_us":25082,"threads_started":1}
I20260812 11:13:30.920356 26164 heartbeater.cc:347] Connected to a master server at 127.4.26.126:37339
I20260812 11:13:30.920758 26164 heartbeater.cc:464] Registering TS with master...
I20260812 11:13:30.921828 26164 heartbeater.cc:511] Master 127.4.26.126:37339 requested a full tablet report, sending...
W20260812 11:13:30.925709 26164 heartbeater.cc:644] Failed to heartbeat to 127.4.26.126:37339 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 11:13:30.925987 26164 heartbeater.cc:464] Registering TS with master...
I20260812 11:13:30.926322 26164 heartbeater.cc:511] Master 127.4.26.126:37339 requested a full tablet report, sending...
I20260812 11:13:30.927834 26164 heartbeater.cc:464] Registering TS with master...
I20260812 11:13:30.928170 26164 heartbeater.cc:511] Master 127.4.26.126:37339 requested a full tablet report, sending...
W20260812 11:13:30.929592 26164 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:13:31.288944 26168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:31.289433 26168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:31.289644 26168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:31.300536 26168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:31.300724 26168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:31.300978 26168 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:13:31.314352 26168 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.4.26.84:53501/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:41571
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=37731
--tserver_master_addrs=127.4.26.126:37339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:31.315941 26168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:31.317395 26168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:31.332823 26189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:31.332828 26191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:31.337018 26188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:31.339447 26168 server_base.cc:1034] running on GCE node
I20260812 11:13:31.340342 26168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:31.341784 26168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:31.343115 26168 hybrid_clock.cc:648] HybridClock initialized: now 1786533211342999 us; error 115 us; skew 500 ppm
I20260812 11:13:31.343549 26168 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:31 dist-test-slave-rmhg krb5kdc[24071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533211, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:31.350592 26168 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:13:31.378729 26168 webserver.cc:460] Webserver started at http://127.4.26.66:37731/ using document root <none> and password file <none>
I20260812 11:13:31.379768 26168 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:31.379966 26168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 11:13:31 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533211, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:13:31.418102 26168 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.006s sys 0.001s
I20260812 11:13:31.421447 26208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:31.423084 26168 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:13:31.423281 26168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "cd8cb261001c4d74bdaecd18c2dcb77b"
format_stamp: "Formatted at 2026-08-12 11:13:28 on dist-test-slave-rmhg"
server_key: "de91c43aae241e7f712f111452a96f2d"
server_key_iv: "0528ffa8d350a3bcd46f282091fbca95"
server_key_version: "kuduclusterkey@0"
I20260812 11:13:31.424346 26168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:31.452811 26168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:31.457711 26168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:31.458039 26168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:31.459177 26168 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:13:31.460911 26168 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:13:31.461087 26168 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:31.461244 26168 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:13:31.461323 26168 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 12 11:13:31 dist-test-slave-rmhg krb5kdc[24071](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786533211, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:31.535164 26168 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:41571
I20260812 11:13:31.535223 26412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:41571 every 8 connection(s)
I20260812 11:13:31.536830 26168 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:13:31.537798 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 26168
I20260812 11:13:31.538697 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.26.84:53501/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:35981
--local_ip_for_outbound_sockets=127.4.26.67
--tserver_master_addrs=127.4.26.126:37339
--webserver_port=43923
--webserver_interface=127.4.26.67
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:42245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.4.26.84:53501/kms with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:13:31 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533211, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:13:31.590842 26417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:31.543552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:36439 (local address 127.4.26.126:37339)
0812 11:13:31.561598 (+ 18046us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:31.561605 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:31.565297 (+ 3692us) server_negotiation.cc:407] Connection header received
0812 11:13:31.565378 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:31.565383 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:31.565476 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:31.565593 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:31.572852 (+ 7259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:31.574109 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:31.576962 (+ 2853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:31.577692 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:31.577801 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:31.582766 (+ 4965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:31.582774 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:31.582779 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:31.582827 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:31.586690 (+ 3863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:31.587776 (+ 1086us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:31.587782 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:31.587785 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:31.587960 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:31.588623 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:31.588628 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:31.588631 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:31.589007 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:31.589138 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:31.590203 (+ 1065us) server_negotiation.cc:299] Negotiation successful
0812 11:13:31.590478 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17885,"thread_start_us":17761,"threads_started":1}
I20260812 11:13:31.593734 26416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:31.542983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37339 (local address 127.4.26.66:36439)
0812 11:13:31.562276 (+ 19293us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:31.562352 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:31.564807 (+ 2455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:31.566129 (+ 1322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:31.566145 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:31.570872 (+ 4727us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:31.572514 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:31.572554 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:31.574425 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:31.574430 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:31.576741 (+ 2311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:31.576763 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:31.578179 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:31.578187 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:31.578538 (+ 351us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:31.579411 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:31.579452 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:31.582384 (+ 2932us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:31.586910 (+ 4526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:31.586922 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:31.586942 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:31.587610 (+ 668us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:31.588124 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:31.588128 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:31.588131 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:31.588408 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:31.589294 (+ 886us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:31.589302 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:31.589737 (+ 435us) client_negotiation.cc:769] Sending connection context
0812 11:13:31.591703 (+ 1966us) client_negotiation.cc:240] Negotiation successful
0812 11:13:31.592316 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18916,"thread_start_us":18655,"threads_started":1}
I20260812 11:13:31.595896 26414 heartbeater.cc:347] Connected to a master server at 127.4.26.126:37339
I20260812 11:13:31.596246 26414 heartbeater.cc:464] Registering TS with master...
I20260812 11:13:31.597009 26414 heartbeater.cc:511] Master 127.4.26.126:37339 requested a full tablet report, sending...
I20260812 11:13:31.599206 25827 ts_manager.cc:194] Registered new tserver with Master: cd8cb261001c4d74bdaecd18c2dcb77b (127.4.26.66:41571)
I20260812 11:13:31.601615 25827 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:36439
I20260812 11:13:31.929747 26164 heartbeater.cc:464] Registering TS with master...
I20260812 11:13:31.930255 26164 heartbeater.cc:511] Master 127.4.26.126:37339 requested a full tablet report, sending...
I20260812 11:13:31.931806 25827 ts_manager.cc:194] Registered new tserver with Master: 12ad6910af094ed997b1b7cba3ffd4fa (127.4.26.65:45599)
I20260812 11:13:31.933388 25827 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:52465
Aug 12 11:13:31 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533211, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
W20260812 11:13:31.987380 26419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:31.987789 26419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:31.987998 26419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:31.999631 26419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:31.999795 26419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:32.000036 26419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:13:32.016220 26419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:42245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.4.26.84:53501/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:35981
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=43923
--tserver_master_addrs=127.4.26.126:37339
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:32.018244 26419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:32.020038 26419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:32.052521 26426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:32.057333 26425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:32.057664 26419 server_base.cc:1034] running on GCE node
W20260812 11:13:32.058010 26428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:32.058990 26419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:32.060379 26419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:32.061654 26419 hybrid_clock.cc:648] HybridClock initialized: now 1786533212061587 us; error 57 us; skew 500 ppm
I20260812 11:13:32.062052 26419 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:32 dist-test-slave-rmhg krb5kdc[24071](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533212, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:32.066464 26419 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:13:32.068894 26419 webserver.cc:460] Webserver started at http://127.4.26.67:43923/ using document root <none> and password file <none>
I20260812 11:13:32.069994 26419 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:32.070188 26419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 12 11:13:32 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533212, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:13:32.094837 26419 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 11:13:32.098925 26442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:32.102717 26419 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.000s
I20260812 11:13:32.103071 26419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "893bc43e458c4be89313f4611f1237f7"
format_stamp: "Formatted at 2026-08-12 11:13:28 on dist-test-slave-rmhg"
server_key: "129d1864cfcb153b01016dca4fcb53a5"
server_key_iv: "b9287d62cf9a9ee602d96103cb00bb5a"
server_key_version: "kuduclusterkey@0"
I20260812 11:13:32.104704 26419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:32.135521 26419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:32.140030 26419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:32.140314 26419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:32.141420 26419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:13:32.142977 26419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:13:32.143078 26419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:32.143200 26419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:13:32.143268 26419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:32.190322 26419 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:35981
I20260812 11:13:32.190373 26654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:35981 every 8 connection(s)
I20260812 11:13:32.191854 26419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:13:32.199753 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 26419
Aug 12 11:13:32 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533212, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:13:32.234084 26666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:32.201048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41412 (local address 127.4.26.126:37339)
0812 11:13:32.212423 (+ 11375us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:32.212431 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:32.212456 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:13:32.212527 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:32.212532 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:32.212637 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:32.212770 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:32.215742 (+ 2972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.217138 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.219356 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.220112 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.220253 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:32.224295 (+ 4042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:32.224303 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:32.224307 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:32.224359 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:32.228471 (+ 4112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:32.229884 (+ 1413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:32.229891 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:32.229895 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:32.230197 (+ 302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:32.231081 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:32.231088 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:32.231091 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:32.231532 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:32.231818 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:32.233388 (+ 1570us) server_negotiation.cc:299] Negotiation successful
0812 11:13:32.233678 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11232,"thread_start_us":11083,"threads_started":1}
I20260812 11:13:32.243175 26661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:32.194938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:35645 (local address 127.4.26.126:37339)
0812 11:13:32.201800 (+ 6862us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:32.201807 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:32.212522 (+ 10715us) server_negotiation.cc:407] Connection header received
0812 11:13:32.215634 (+ 3112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:32.215643 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:32.215749 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:32.215873 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:32.219688 (+ 3815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.221450 (+ 1762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.224333 (+ 2883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.225244 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.225380 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:32.234961 (+ 9581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:32.234969 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:32.234974 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:32.235020 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:32.239014 (+ 3994us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:32.240190 (+ 1176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:32.240196 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:32.240200 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:32.240394 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:32.240911 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:32.240917 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:32.240920 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:32.241334 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:32.241494 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:32.242502 (+ 1008us) server_negotiation.cc:299] Negotiation successful
0812 11:13:32.242771 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6704,"thread_start_us":6510,"threads_started":1}
I20260812 11:13:32.245175 26662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:32.195663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37339 (local address 127.4.26.67:35645)
0812 11:13:32.212301 (+ 16638us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:32.212373 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:32.215060 (+ 2687us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:32.217231 (+ 2171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:32.217256 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:32.218298 (+ 1042us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:32.219353 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:32.219385 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.221735 (+ 2350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.221741 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:32.224096 (+ 2355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:32.224121 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.225874 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.225885 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:32.226295 (+ 410us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:32.227023 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:32.227070 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:32.231023 (+ 3953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:32.239237 (+ 8214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:32.239250 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:32.239271 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:32.240013 (+ 742us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:32.240539 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:32.240543 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:32.240546 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:32.240773 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:32.241607 (+ 834us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:32.241616 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:32.242071 (+ 455us) client_negotiation.cc:769] Sending connection context
0812 11:13:32.242349 (+ 278us) client_negotiation.cc:240] Negotiation successful
0812 11:13:32.242998 (+ 649us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16264,"thread_start_us":16482,"threads_started":1}
I20260812 11:13:32.246938 26659 heartbeater.cc:347] Connected to a master server at 127.4.26.126:37339
I20260812 11:13:32.247291 26659 heartbeater.cc:464] Registering TS with master...
I20260812 11:13:32.248091 26659 heartbeater.cc:511] Master 127.4.26.126:37339 requested a full tablet report, sending...
I20260812 11:13:32.250022 25826 ts_manager.cc:194] Registered new tserver with Master: 893bc43e458c4be89313f4611f1237f7 (127.4.26.67:35981)
I20260812 11:13:32.250906 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:13:32.251489 25826 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:35645
I20260812 11:13:32.272042 26661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:32.257941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41422 (local address 127.4.26.126:37339)
0812 11:13:32.258138 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:32.258145 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:32.258268 (+ 123us) server_negotiation.cc:407] Connection header received
0812 11:13:32.258540 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:32.258544 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:32.258627 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:32.258712 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:32.260257 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.260977 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.262690 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.263178 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.263309 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:32.266229 (+ 2920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:32.266234 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:32.266237 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:32.266279 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:32.269095 (+ 2816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:32.269897 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:32.269903 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:32.269905 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:32.270042 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:32.270427 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:32.270432 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:32.270434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:32.270740 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:32.270970 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:32.271326 (+ 356us) server_negotiation.cc:299] Negotiation successful
0812 11:13:32.271577 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260812 11:13:32.279507 25826 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41422:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:13:32.289402 25826 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 12 11:13:32 dist-test-slave-rmhg krb5kdc[24071](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533211, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for HTTP/127.4.26.84@KRBTEST.COM
I20260812 11:13:32.355796 26696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:32.322865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47576 (local address 127.4.26.65:45599)
0812 11:13:32.342285 (+ 19420us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:32.342296 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:32.346087 (+ 3791us) server_negotiation.cc:407] Connection header received
0812 11:13:32.346329 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:32.346339 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:32.346681 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:32.346928 (+ 247us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:13:32.347992 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.349703 (+ 1711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.352712 (+ 3009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.354222 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.354328 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:32.354570 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:32.355286 (+ 716us) server_negotiation.cc:299] Negotiation successful
0812 11:13:32.355473 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19181,"thread_start_us":19432,"threads_started":1}
I20260812 11:13:32.356931 26697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:32.322530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45599 (local address 127.0.0.1:47576)
0812 11:13:32.345893 (+ 23363us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:32.345921 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:32.346143 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:32.347270 (+ 1127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:32.347277 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:32.347314 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:13:32.347739 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:32.347754 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.349934 (+ 2180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.349939 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:32.352494 (+ 2555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:32.352515 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.354800 (+ 2285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.354806 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:32.355013 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:32.355065 (+ 52us) client_negotiation.cc:769] Sending connection context
0812 11:13:32.356311 (+ 1246us) client_negotiation.cc:240] Negotiation successful
0812 11:13:32.356562 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23188,"thread_start_us":33328,"threads_started":1}
I20260812 11:13:32.361946 26044 tablet_service.cc:1467] Processing CreateTablet for tablet b5961c49584144e484dcccd02d54c4c6 (DEFAULT_TABLE table=test-table [id=ea42613be1d74a938dcfb8376899c58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:13:32.364151 26044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5961c49584144e484dcccd02d54c4c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:13:32.365360 26693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:32.331332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:35981 (local address 127.0.0.1:53442)
0812 11:13:32.354478 (+ 23146us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:32.354504 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:32.354658 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:32.356421 (+ 1763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:32.356426 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:32.356457 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:13:32.356930 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:32.356946 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.359038 (+ 2092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.359043 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:32.361827 (+ 2784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:32.361845 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.364501 (+ 2656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.364509 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:32.364688 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:32.364724 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:13:32.364814 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 11:13:32.364968 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22968,"thread_start_us":14187,"threads_started":1}
I20260812 11:13:32.366350 26698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:32.332110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53442 (local address 127.4.26.67:35981)
0812 11:13:32.346824 (+ 14714us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:32.346835 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:32.354826 (+ 7991us) server_negotiation.cc:407] Connection header received
0812 11:13:32.354978 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:32.354988 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:32.355313 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:32.355558 (+ 245us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:13:32.357194 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.358840 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.362283 (+ 3443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.363806 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.363941 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:32.364181 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:32.365762 (+ 1581us) server_negotiation.cc:299] Negotiation successful
0812 11:13:32.365963 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14503,"thread_start_us":14310,"threads_started":1}
I20260812 11:13:32.367547 26689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:32.319451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:41571 (local address 127.0.0.1:52416)
0812 11:13:32.334195 (+ 14744us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:32.334249 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:32.334485 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:32.359733 (+ 25248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:32.359738 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:32.359774 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:13:32.360236 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:32.360260 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.362501 (+ 2241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.362507 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:32.364589 (+ 2082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:32.364607 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.366754 (+ 2147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.366761 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:32.366934 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:32.366972 (+ 38us) client_negotiation.cc:769] Sending connection context
0812 11:13:32.367056 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 11:13:32.367201 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14400,"thread_start_us":14220,"threads_started":1}
I20260812 11:13:32.368712 26692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:32.320060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52416 (local address 127.4.26.66:41571)
0812 11:13:32.358959 (+ 38899us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:32.358969 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:32.359014 (+ 45us) server_negotiation.cc:407] Connection header received
0812 11:13:32.359124 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:32.359132 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:32.359416 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:32.360389 (+ 973us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:13:32.360622 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.362299 (+ 1677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.364962 (+ 2663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.366497 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.367916 (+ 1419us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:32.368143 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:32.368222 (+ 79us) server_negotiation.cc:299] Negotiation successful
0812 11:13:32.368404 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38709,"thread_start_us":41897,"threads_started":1}
I20260812 11:13:32.371014 26540 tablet_service.cc:1467] Processing CreateTablet for tablet b5961c49584144e484dcccd02d54c4c6 (DEFAULT_TABLE table=test-table [id=ea42613be1d74a938dcfb8376899c58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:13:32.372813 26540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5961c49584144e484dcccd02d54c4c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:13:32.372948 26300 tablet_service.cc:1467] Processing CreateTablet for tablet b5961c49584144e484dcccd02d54c4c6 (DEFAULT_TABLE table=test-table [id=ea42613be1d74a938dcfb8376899c58f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:13:32.385953 26300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5961c49584144e484dcccd02d54c4c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:13:32.412919 26699 tablet_bootstrap.cc:492] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa: Bootstrap starting.
I20260812 11:13:32.418494 26699 tablet_bootstrap.cc:654] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa: Neither blocks nor log segments found. Creating new log.
I20260812 11:13:32.419539 26704 tablet_bootstrap.cc:492] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7: Bootstrap starting.
I20260812 11:13:32.422710 26703 tablet_bootstrap.cc:492] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b: Bootstrap starting.
I20260812 11:13:32.425927 26699 log.cc:824] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:32.426694 26703 tablet_bootstrap.cc:654] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b: Neither blocks nor log segments found. Creating new log.
I20260812 11:13:32.427055 26704 tablet_bootstrap.cc:654] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7: Neither blocks nor log segments found. Creating new log.
I20260812 11:13:32.428123 26703 log.cc:824] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:32.429039 26704 log.cc:824] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:32.439846 26704 tablet_bootstrap.cc:492] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7: No bootstrap required, opened a new log
I20260812 11:13:32.440259 26704 ts_tablet_manager.cc:1397] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.005s
I20260812 11:13:32.452950 26699 tablet_bootstrap.cc:492] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa: No bootstrap required, opened a new log
I20260812 11:13:32.453362 26699 ts_tablet_manager.cc:1397] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa: Time spent bootstrapping tablet: real 0.041s user 0.018s sys 0.008s
I20260812 11:13:32.456099 26704 raft_consensus.cc:348] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd8cb261001c4d74bdaecd18c2dcb77b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41571 } } peers { permanent_uuid: "12ad6910af094ed997b1b7cba3ffd4fa" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45599 } } peers { permanent_uuid: "893bc43e458c4be89313f4611f1237f7" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 35981 } }
I20260812 11:13:32.456636 26704 raft_consensus.cc:374] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:13:32.456732 26704 raft_consensus.cc:729] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 893bc43e458c4be89313f4611f1237f7, State: Initialized, Role: FOLLOWER
I20260812 11:13:32.457669 26704 consensus_queue.cc:260] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd8cb261001c4d74bdaecd18c2dcb77b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41571 } } peers { permanent_uuid: "12ad6910af094ed997b1b7cba3ffd4fa" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45599 } } peers { permanent_uuid: "893bc43e458c4be89313f4611f1237f7" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 35981 } }
I20260812 11:13:32.463425 26659 heartbeater.cc:503] Master 127.4.26.126:37339 was elected leader, sending a full tablet report...
I20260812 11:13:32.464268 26704 ts_tablet_manager.cc:1428] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7: Time spent starting tablet: real 0.024s user 0.019s sys 0.001s
I20260812 11:13:32.467343 26703 tablet_bootstrap.cc:492] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b: No bootstrap required, opened a new log
I20260812 11:13:32.467886 26703 ts_tablet_manager.cc:1397] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b: Time spent bootstrapping tablet: real 0.045s user 0.015s sys 0.013s
I20260812 11:13:32.470861 26699 raft_consensus.cc:348] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd8cb261001c4d74bdaecd18c2dcb77b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41571 } } peers { permanent_uuid: "12ad6910af094ed997b1b7cba3ffd4fa" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45599 } } peers { permanent_uuid: "893bc43e458c4be89313f4611f1237f7" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 35981 } }
I20260812 11:13:32.471386 26699 raft_consensus.cc:374] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:13:32.471493 26699 raft_consensus.cc:729] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ad6910af094ed997b1b7cba3ffd4fa, State: Initialized, Role: FOLLOWER
I20260812 11:13:32.472178 26699 consensus_queue.cc:260] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd8cb261001c4d74bdaecd18c2dcb77b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41571 } } peers { permanent_uuid: "12ad6910af094ed997b1b7cba3ffd4fa" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45599 } } peers { permanent_uuid: "893bc43e458c4be89313f4611f1237f7" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 35981 } }
I20260812 11:13:32.473387 26164 heartbeater.cc:503] Master 127.4.26.126:37339 was elected leader, sending a full tablet report...
I20260812 11:13:32.474186 26699 ts_tablet_manager.cc:1428] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa: Time spent starting tablet: real 0.021s user 0.006s sys 0.008s
I20260812 11:13:32.477735 26703 raft_consensus.cc:348] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd8cb261001c4d74bdaecd18c2dcb77b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41571 } } peers { permanent_uuid: "12ad6910af094ed997b1b7cba3ffd4fa" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45599 } } peers { permanent_uuid: "893bc43e458c4be89313f4611f1237f7" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 35981 } }
I20260812 11:13:32.478263 26703 raft_consensus.cc:374] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:13:32.478379 26703 raft_consensus.cc:729] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd8cb261001c4d74bdaecd18c2dcb77b, State: Initialized, Role: FOLLOWER
I20260812 11:13:32.479184 26703 consensus_queue.cc:260] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd8cb261001c4d74bdaecd18c2dcb77b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41571 } } peers { permanent_uuid: "12ad6910af094ed997b1b7cba3ffd4fa" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45599 } } peers { permanent_uuid: "893bc43e458c4be89313f4611f1237f7" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 35981 } }
I20260812 11:13:32.488008 26703 ts_tablet_manager.cc:1428] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b: Time spent starting tablet: real 0.020s user 0.012s sys 0.007s
I20260812 11:13:32.488494 26414 heartbeater.cc:503] Master 127.4.26.126:37339 was elected leader, sending a full tablet report...
W20260812 11:13:32.543409 26415 tablet.cc:2369] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:13:32.615262 26165 tablet.cc:2369] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:13:32.698980 26712 raft_consensus.cc:482] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:13:32.699420 26712 raft_consensus.cc:504] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd8cb261001c4d74bdaecd18c2dcb77b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41571 } } peers { permanent_uuid: "12ad6910af094ed997b1b7cba3ffd4fa" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45599 } } peers { permanent_uuid: "893bc43e458c4be89313f4611f1237f7" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 35981 } }
I20260812 11:13:32.701802 26712 leader_election.cc:288] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12ad6910af094ed997b1b7cba3ffd4fa (127.4.26.65:45599), 893bc43e458c4be89313f4611f1237f7 (127.4.26.67:35981)
I20260812 11:13:32.709985 26698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:32.702294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:33825 (local address 127.4.26.67:35981)
0812 11:13:32.702498 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:32.702504 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:32.703940 (+ 1436us) server_negotiation.cc:407] Connection header received
0812 11:13:32.704082 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:32.704086 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:32.704167 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:32.704256 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:13:32.705095 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.706164 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.707989 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.708928 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.709060 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:32.709210 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:32.709589 (+ 379us) server_negotiation.cc:299] Negotiation successful
0812 11:13:32.709730 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 11:13:32.710428 26733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:32.702765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:35981 (local address 127.4.26.66:33825)
0812 11:13:32.703833 (+ 1068us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:32.703850 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:32.703952 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:32.704336 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:32.704340 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:32.704372 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:13:32.704863 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:32.704875 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.706298 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.706303 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:32.707826 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:32.707841 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.709199 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.709208 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:32.709387 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:32.709424 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:13:32.709540 (+ 116us) client_negotiation.cc:240] Negotiation successful
0812 11:13:32.709688 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":938,"mutex_wait_us":30,"thread_start_us":711,"threads_started":1}
I20260812 11:13:32.711167 26696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:32.702222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:38025 (local address 127.4.26.65:45599)
0812 11:13:32.702487 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:32.702494 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:32.703574 (+ 1080us) server_negotiation.cc:407] Connection header received
0812 11:13:32.703903 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:32.703909 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:32.704011 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:32.704131 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:13:32.704774 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.705936 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.708536 (+ 2600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.709641 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.709759 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:32.709858 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:32.710771 (+ 913us) server_negotiation.cc:299] Negotiation successful
0812 11:13:32.710922 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260812 11:13:32.711833 26731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:32.702679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45599 (local address 127.4.26.66:38025)
0812 11:13:32.703439 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:32.703464 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:32.703715 (+ 251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:32.704159 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:32.704163 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:32.704187 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:13:32.704623 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:32.704634 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.706098 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.706104 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:32.708354 (+ 2250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:32.708370 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.710037 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.710043 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:32.710516 (+ 473us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:32.710552 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:13:32.711360 (+ 808us) client_negotiation.cc:240] Negotiation successful
0812 11:13:32.711510 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"mutex_wait_us":70,"thread_start_us":416,"threads_started":1}
I20260812 11:13:32.711815 26583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5961c49584144e484dcccd02d54c4c6" candidate_uuid: "cd8cb261001c4d74bdaecd18c2dcb77b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "893bc43e458c4be89313f4611f1237f7" is_pre_election: true
W20260812 11:13:32.712507 26660 tablet.cc:2369] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:13:32.712548 26583 raft_consensus.cc:2454] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd8cb261001c4d74bdaecd18c2dcb77b in term 0.
I20260812 11:13:32.712950 26078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5961c49584144e484dcccd02d54c4c6" candidate_uuid: "cd8cb261001c4d74bdaecd18c2dcb77b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12ad6910af094ed997b1b7cba3ffd4fa" is_pre_election: true
I20260812 11:13:32.713591 26078 raft_consensus.cc:2454] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd8cb261001c4d74bdaecd18c2dcb77b in term 0.
I20260812 11:13:32.713778 26213 leader_election.cc:302] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 893bc43e458c4be89313f4611f1237f7, cd8cb261001c4d74bdaecd18c2dcb77b; no voters:
I20260812 11:13:32.714262 26712 raft_consensus.cc:2781] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:13:32.714407 26712 raft_consensus.cc:482] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:13:32.714521 26712 raft_consensus.cc:3037] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:13:32.716787 26712 raft_consensus.cc:504] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd8cb261001c4d74bdaecd18c2dcb77b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41571 } } peers { permanent_uuid: "12ad6910af094ed997b1b7cba3ffd4fa" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45599 } } peers { permanent_uuid: "893bc43e458c4be89313f4611f1237f7" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 35981 } }
I20260812 11:13:32.717500 26712 leader_election.cc:288] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [CANDIDATE]: Term 1 election: Requested vote from peers 12ad6910af094ed997b1b7cba3ffd4fa (127.4.26.65:45599), 893bc43e458c4be89313f4611f1237f7 (127.4.26.67:35981)
I20260812 11:13:32.718186 26078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5961c49584144e484dcccd02d54c4c6" candidate_uuid: "cd8cb261001c4d74bdaecd18c2dcb77b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12ad6910af094ed997b1b7cba3ffd4fa"
I20260812 11:13:32.718186 26583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5961c49584144e484dcccd02d54c4c6" candidate_uuid: "cd8cb261001c4d74bdaecd18c2dcb77b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "893bc43e458c4be89313f4611f1237f7"
I20260812 11:13:32.718420 26078 raft_consensus.cc:3037] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:13:32.718420 26583 raft_consensus.cc:3037] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:13:32.721737 26078 raft_consensus.cc:2454] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd8cb261001c4d74bdaecd18c2dcb77b in term 1.
I20260812 11:13:32.721737 26583 raft_consensus.cc:2454] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd8cb261001c4d74bdaecd18c2dcb77b in term 1.
I20260812 11:13:32.722364 26213 leader_election.cc:302] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 893bc43e458c4be89313f4611f1237f7, cd8cb261001c4d74bdaecd18c2dcb77b; no voters:
I20260812 11:13:32.722692 26712 raft_consensus.cc:2781] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:13:32.723240 26712 raft_consensus.cc:686] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [term 1 LEADER]: Becoming Leader. State: Replica: cd8cb261001c4d74bdaecd18c2dcb77b, State: Running, Role: LEADER
I20260812 11:13:32.723821 26712 consensus_queue.cc:237] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd8cb261001c4d74bdaecd18c2dcb77b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41571 } } peers { permanent_uuid: "12ad6910af094ed997b1b7cba3ffd4fa" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45599 } } peers { permanent_uuid: "893bc43e458c4be89313f4611f1237f7" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 35981 } }
I20260812 11:13:32.728804 25826 catalog_manager.cc:5495] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b reported cstate change: term changed from 0 to 1, leader changed from <none> to cd8cb261001c4d74bdaecd18c2dcb77b (127.4.26.66). New cstate: current_term: 1 leader_uuid: "cd8cb261001c4d74bdaecd18c2dcb77b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd8cb261001c4d74bdaecd18c2dcb77b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 41571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12ad6910af094ed997b1b7cba3ffd4fa" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "893bc43e458c4be89313f4611f1237f7" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 35981 } health_report { overall_health: UNKNOWN } } }
I20260812 11:13:32.760588 26692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:32.755235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52432 (local address 127.4.26.66:41571)
0812 11:13:32.755455 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:32.755461 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:32.755480 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:13:32.755585 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:32.755588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:32.755680 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:32.755812 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:13:32.756202 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.756927 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.758368 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.758802 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.758916 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:32.759425 (+ 509us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:13:32.759969 (+ 544us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:13:32.760127 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:32.760208 (+ 81us) server_negotiation.cc:299] Negotiation successful
0812 11:13:32.760300 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:13:32.770907 26583 raft_consensus.cc:1261] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7 [term 1 FOLLOWER]: Refusing update from remote peer cd8cb261001c4d74bdaecd18c2dcb77b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:13:32.770951 26078 raft_consensus.cc:1261] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa [term 1 FOLLOWER]: Refusing update from remote peer cd8cb261001c4d74bdaecd18c2dcb77b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:13:32.772023 26712 consensus_queue.cc:1035] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [LEADER]: Connected to new peer: Peer: permanent_uuid: "893bc43e458c4be89313f4611f1237f7" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 35981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:13:32.772362 26734 consensus_queue.cc:1035] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ad6910af094ed997b1b7cba3ffd4fa" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:13:32.784754 26742 mvcc.cc:205] Tried to move back new op lower bound from 7317640039498133504 to 7317640039320879104. Current Snapshot: MvccSnapshot[applied={T|T < 7317640039498133504}]
I20260812 11:13:32.786509 26743 mvcc.cc:205] Tried to move back new op lower bound from 7317640039498133504 to 7317640039320879104. Current Snapshot: MvccSnapshot[applied={T|T < 7317640039498133504}]
I20260812 11:13:32.816543 25826 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:13:32.816854 25826 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:13:32.820623 25826 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5c5606d3e35448a5bdfafceee2247748: Sending DeleteTablet for 3 replicas of tablet b5961c49584144e484dcccd02d54c4c6
I20260812 11:13:32.821997 26540 tablet_service.cc:1514] Processing DeleteTablet for tablet b5961c49584144e484dcccd02d54c4c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:13:32 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:53442
I20260812 11:13:32.822005 26300 tablet_service.cc:1514] Processing DeleteTablet for tablet b5961c49584144e484dcccd02d54c4c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:13:32 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:52416
I20260812 11:13:32.823400 26044 tablet_service.cc:1514] Processing DeleteTablet for tablet b5961c49584144e484dcccd02d54c4c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:13:32 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:47576
I20260812 11:13:32.831619 26763 tablet_replica.cc:330] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa: stopping tablet replica
I20260812 11:13:32.832854 26763 raft_consensus.cc:2229] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:13:32.832983 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 25888
I20260812 11:13:32.834285 26763 raft_consensus.cc:2258] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:13:32.838025 26763 ts_tablet_manager.cc:1905] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:13:32.844129 26762 tablet_replica.cc:330] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7: stopping tablet replica
I20260812 11:13:32.844741 26762 raft_consensus.cc:2229] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:13:32.845389 26762 raft_consensus.cc:2258] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:13:32.849509 26758 tablet_replica.cc:330] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b: stopping tablet replica
I20260812 11:13:32.850059 26758 raft_consensus.cc:2229] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:13:32.850797 26758 raft_consensus.cc:2258] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:13:32.851572 26763 ts_tablet_manager.cc:1918] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:13:32.851861 26763 log.cc:1196] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/b5961c49584144e484dcccd02d54c4c6
I20260812 11:13:32.852569 26763 ts_tablet_manager.cc:1939] T b5961c49584144e484dcccd02d54c4c6 P 12ad6910af094ed997b1b7cba3ffd4fa: Deleting consensus metadata
I20260812 11:13:32.857105 26762 ts_tablet_manager.cc:1905] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:13:32.859692 26758 ts_tablet_manager.cc:1905] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:13:32.867250 25805 catalog_manager.cc:4841] TS 12ad6910af094ed997b1b7cba3ffd4fa (127.4.26.65:45599): tablet b5961c49584144e484dcccd02d54c4c6 (table test-table [id=ea42613be1d74a938dcfb8376899c58f]) successfully deleted
I20260812 11:13:32.878037 26762 ts_tablet_manager.cc:1918] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:13:32.878249 26762 log.cc:1196] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/b5961c49584144e484dcccd02d54c4c6
I20260812 11:13:32.878803 26762 ts_tablet_manager.cc:1939] T b5961c49584144e484dcccd02d54c4c6 P 893bc43e458c4be89313f4611f1237f7: Deleting consensus metadata
I20260812 11:13:32.880877 25802 catalog_manager.cc:4841] TS 893bc43e458c4be89313f4611f1237f7 (127.4.26.67:35981): tablet b5961c49584144e484dcccd02d54c4c6 (table test-table [id=ea42613be1d74a938dcfb8376899c58f]) successfully deleted
I20260812 11:13:32.883894 26758 ts_tablet_manager.cc:1918] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:13:32.884110 26758 log.cc:1196] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/b5961c49584144e484dcccd02d54c4c6
I20260812 11:13:32.884764 26758 ts_tablet_manager.cc:1939] T b5961c49584144e484dcccd02d54c4c6 P cd8cb261001c4d74bdaecd18c2dcb77b: Deleting consensus metadata
I20260812 11:13:32.888288 25806 catalog_manager.cc:4841] TS cd8cb261001c4d74bdaecd18c2dcb77b (127.4.26.66:41571): tablet b5961c49584144e484dcccd02d54c4c6 (table test-table [id=ea42613be1d74a938dcfb8376899c58f]) successfully deleted
I20260812 11:13:32.889655 26696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:32.834952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47580 (local address 127.4.26.65:45599)
0812 11:13:32.835164 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:32.835171 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:32.846395 (+ 11224us) server_negotiation.cc:407] Connection header received
0812 11:13:32.846779 (+ 384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:32.846786 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:32.846877 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:32.846952 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:32.853512 (+ 6560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.854687 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.866647 (+ 11960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:32.867308 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:32.867423 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:32.881350 (+ 13927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:32.881373 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:32.881395 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:32.881442 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:32.885690 (+ 4248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:32.886756 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:32.886768 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:32.886771 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:32.886950 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:32.887482 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:32.887488 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:32.887491 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:32.888007 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:32.888330 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:32.889035 (+ 705us) server_negotiation.cc:299] Negotiation successful
0812 11:13:32.889301 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260812 11:13:32.890295 26154 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:32.982343 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 25888
I20260812 11:13:33.006757 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 26168
I20260812 11:13:33.021238 26692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:33.007557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52448 (local address 127.4.26.66:41571)
0812 11:13:33.007813 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:33.007820 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:33.007862 (+ 42us) server_negotiation.cc:407] Connection header received
0812 11:13:33.008078 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:33.008083 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:33.008162 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:33.008249 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:33.009718 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:33.010635 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:33.012105 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:33.012567 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:33.012690 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:33.015278 (+ 2588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:33.015292 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:33.015311 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:33.015350 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:33.018304 (+ 2954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:33.019001 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:33.019013 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:33.019016 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:33.019175 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:33.019561 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:33.019565 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:33.019568 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:33.019936 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:33.020277 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:33.020562 (+ 285us) server_negotiation.cc:299] Negotiation successful
0812 11:13:33.020807 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260812 11:13:33.021958 26408 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:33.135281 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 26168
I20260812 11:13:33.161677 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 26419
I20260812 11:13:33.176479 26698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:33.162487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53446 (local address 127.4.26.67:35981)
0812 11:13:33.162688 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:33.162694 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:33.162716 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:13:33.162945 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:33.162950 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:33.163026 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:33.163139 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:33.164519 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:33.165327 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:33.166817 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:33.167302 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:33.167422 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:33.170359 (+ 2937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:33.170376 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:33.170395 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:33.170433 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:33.173341 (+ 2908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:33.174141 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:33.174149 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:33.174152 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:33.174307 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:33.174732 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:33.174736 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:33.174739 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:33.175175 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:33.175477 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:33.175822 (+ 345us) server_negotiation.cc:299] Negotiation successful
0812 11:13:33.176099 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 11:13:33.177361 26649 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:33.266403 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 26419
I20260812 11:13:33.298763 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 25772
I20260812 11:13:33.300053 25878 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:33.413695 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 25772
I20260812 11:13:33.452407 4201 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260812 11:13:33.799989 4201 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260812 11:13:33.800206 4201 mini_ranger.cc:66] Stopping Ranger...
I20260812 11:13:34.137835 4201 mini_ranger.cc:68] Stopped Ranger
2026-08-12 11:13:34.138 UTC [24123] LOG: received smart shutdown request
2026-08-12 11:13:34.141 UTC [24123] LOG: background worker "logical replication launcher" (PID 24138) exited with exit code 1
2026-08-12 11:13:34.141 UTC [24132] LOG: shutting down
2026-08-12 11:13:34.304 UTC [24123] LOG: database system is shut down
2026-08-12T11:13:34Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (54962 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:13:34 dist-test-slave-rmhg krb5kdc[26787](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:13:34 dist-test-slave-rmhg krb5kdc[26787](info): set up 2 sockets
Aug 12 11:13:34 dist-test-slave-rmhg krb5kdc[26787](info): commencing operation
krb5kdc: starting...
W20260812 11:13:35.678417 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.001s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:13:35 dist-test-slave-rmhg krb5kdc[26787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:13:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:13:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:13:35.961211 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:35485
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:33253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:35485,127.4.26.125:34881,127.4.26.124:33653
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:13:36.335979 26806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:36.336314 26806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:36.336454 26806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:36.344272 26806 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:13:36.344409 26806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:36.344486 26806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:36.344580 26806 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:13:36.344637 26806 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:13:36.355139 26806 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:33253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:35485,127.4.26.125:34881,127.4.26.124:33653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:35485
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:36.356623 26806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:36.358136 26806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:36.370900 26816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:36.370970 26817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:36.370944 26820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:36.371904 26806 server_base.cc:1034] running on GCE node
I20260812 11:13:36.372786 26806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:36.374416 26806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:36.375662 26806 hybrid_clock.cc:648] HybridClock initialized: now 1786533216375610 us; error 38 us; skew 500 ppm
I20260812 11:13:36.376133 26806 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:36 dist-test-slave-rmhg krb5kdc[26787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533216, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:36.380788 26806 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:13:36.382944 26806 webserver.cc:460] Webserver started at http://127.4.26.126:40541/ using document root <none> and password file <none>
I20260812 11:13:36.384021 26806 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:36.384194 26806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:36.384613 26806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:13:36.387864 26806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "69bbb0959ff5467091252f216c07fb6a"
format_stamp: "Formatted at 2026-08-12 11:13:36 on dist-test-slave-rmhg"
server_key: "b522deede0313fef1ff34524d988f169"
server_key_iv: "138f0299e8047252345687c93811c362"
server_key_version: "encryptionkey@0"
I20260812 11:13:36.388736 26806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "69bbb0959ff5467091252f216c07fb6a"
format_stamp: "Formatted at 2026-08-12 11:13:36 on dist-test-slave-rmhg"
server_key: "b522deede0313fef1ff34524d988f169"
server_key_iv: "138f0299e8047252345687c93811c362"
server_key_version: "encryptionkey@0"
I20260812 11:13:36.394554 26806 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 11:13:36.398419 26833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:36.399959 26806 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:13:36.400179 26806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "69bbb0959ff5467091252f216c07fb6a"
format_stamp: "Formatted at 2026-08-12 11:13:36 on dist-test-slave-rmhg"
server_key: "b522deede0313fef1ff34524d988f169"
server_key_iv: "138f0299e8047252345687c93811c362"
server_key_version: "encryptionkey@0"
I20260812 11:13:36.400388 26806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:36.416973 26806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:36.421177 26806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:36.421456 26806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:36.439823 26806 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:35485
I20260812 11:13:36.439857 26917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:35485 every 8 connection(s)
I20260812 11:13:36.441421 26806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:13:36.441859 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 26806
I20260812 11:13:36.442113 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:13:36.442960 4201 external_mini_cluster.cc:1428] Setting key 9f08f4c7ca1b15c535d96f0ef3a2db43
I20260812 11:13:36.445765 26918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:13:36.453217 26918 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.4.26.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.125@KRBTEST.COM" created.
Aug 12 11:13:36 dist-test-slave-rmhg krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533216, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:13:36.483670 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:36.457009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:35485 (local address 127.0.0.1:45876)
0812 11:13:36.458542 (+ 1533us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:36.458598 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:36.461201 (+ 2603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:36.462267 (+ 1066us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:36.462274 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:36.463050 (+ 776us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:36.463537 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:36.463563 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:36.465297 (+ 1734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:36.465303 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:36.467096 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:36.467113 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:36.468168 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:36.468177 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:36.468367 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:36.469107 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:36.469140 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:36.474759 (+ 5619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:36.479120 (+ 4361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:36.479134 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:36.479146 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:36.479637 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:36.480217 (+ 580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:36.480220 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:36.480223 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:36.480405 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:36.481539 (+ 1134us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:36.481546 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:36.481790 (+ 244us) client_negotiation.cc:769] Sending connection context
0812 11:13:36.482028 (+ 238us) client_negotiation.cc:240] Negotiation successful
0812 11:13:36.482482 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1225,"spinlock_wait_cycles":65792,"thread_start_us":926,"threads_started":1}
I20260812 11:13:36.483696 26923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:36.457009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45876 (local address 127.4.26.126:35485)
0812 11:13:36.458095 (+ 1086us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:36.458117 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:36.458766 (+ 649us) server_negotiation.cc:407] Connection header received
0812 11:13:36.461698 (+ 2932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:36.461705 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:36.461986 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:36.462169 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:36.463780 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:36.465110 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:36.467263 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:36.467896 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:36.468059 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:36.475096 (+ 7037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:36.475109 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:36.475154 (+ 45us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:36.475202 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:36.478922 (+ 3720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:36.479792 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:36.479803 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:36.479806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:36.480025 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:36.480520 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:36.480524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:36.480527 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:36.481328 (+ 801us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:36.481555 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:36.482207 (+ 652us) server_negotiation.cc:299] Negotiation successful
0812 11:13:36.482650 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":140,"server-negotiator.queue_time_us":757,"thread_start_us":448,"threads_started":1}
I20260812 11:13:36.486941 26918 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:13:36.487974 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:36.487593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:34881 (local address 127.0.0.1:56082)
0812 11:13:36.487741 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:36.487856 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:34881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 11:13:36.488253 26835 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.26.125:34881: connect: Connection refused (error 111)
I20260812 11:13:36.489921 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:36.489575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:34881 (local address 127.0.0.1:56092)
0812 11:13:36.489712 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:36.489782 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:34881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 11:13:36.490136 26918 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.125:34881: Network error: Client connection negotiation failed: client connection to 127.4.26.125:34881: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.125.keytab.
Entry for principal kudu/127.4.26.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.125.keytab.
I20260812 11:13:36.506764 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.125:34881
--webserver_interface=127.4.26.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.125.keytab
--principal=kudu/127.4.26.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:33253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:35485,127.4.26.125:34881,127.4.26.124:33653
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:13:36.539597 26918 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } attempt: 1
I20260812 11:13:36.540851 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:36.540366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:34881 (local address 127.0.0.1:56096)
0812 11:13:36.540576 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:36.540699 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:34881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260812 11:13:36.541953 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:36.541576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:34881 (local address 127.0.0.1:56106)
0812 11:13:36.541732 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:36.541810 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:34881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 11:13:36.542135 26918 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.125:34881: Network error: Client connection negotiation failed: client connection to 127.4.26.125:34881: connect: Connection refused (error 111)
I20260812 11:13:36.610389 26918 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } attempt: 2
I20260812 11:13:36.611729 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:36.611173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:34881 (local address 127.0.0.1:56116)
0812 11:13:36.611470 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:36.611576 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:34881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260812 11:13:36.612823 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:36.612407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:34881 (local address 127.0.0.1:56128)
0812 11:13:36.612595 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:36.612686 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:34881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 11:13:36.612998 26918 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.125:34881: Network error: Client connection negotiation failed: client connection to 127.4.26.125:34881: connect: Connection refused (error 111)
I20260812 11:13:36.704300 26918 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } attempt: 3
I20260812 11:13:36.705654 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:36.705031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:34881 (local address 127.0.0.1:56132)
0812 11:13:36.705284 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:36.705403 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:34881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 11:13:36.706857 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:36.706394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:34881 (local address 127.0.0.1:56134)
0812 11:13:36.706562 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:36.706675 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:34881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 11:13:36.707093 26918 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.125:34881: Network error: Client connection negotiation failed: client connection to 127.4.26.125:34881: connect: Connection refused (error 111)
I20260812 11:13:36.850345 26918 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } attempt: 4
I20260812 11:13:36.851723 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:36.851106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:34881 (local address 127.0.0.1:56142)
0812 11:13:36.851441 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:36.851554 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:34881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167}
I20260812 11:13:36.852908 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:36.852495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:34881 (local address 127.0.0.1:56156)
0812 11:13:36.852642 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:36.852753 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:34881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260812 11:13:36.853179 26918 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.125:34881: Network error: Client connection negotiation failed: client connection to 127.4.26.125:34881: connect: Connection refused (error 111)
W20260812 11:13:36.855504 26929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:36.855818 26929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:36.855922 26929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:36.863440 26929 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:13:36.863561 26929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:36.863607 26929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:36.863667 26929 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:13:36.863711 26929 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:13:36.873960 26929 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:33253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:35485,127.4.26.125:34881,127.4.26.124:33653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.125.keytab
--principal=kudu/127.4.26.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.125:34881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.26.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:36.875308 26929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:36.876609 26929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:36.889068 26943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:36.888999 26946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:36.889075 26944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:36.889716 26929 server_base.cc:1034] running on GCE node
I20260812 11:13:36.890578 26929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:36.892146 26929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:36.893359 26929 hybrid_clock.cc:648] HybridClock initialized: now 1786533216893308 us; error 50 us; skew 500 ppm
I20260812 11:13:36.893738 26929 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:36 dist-test-slave-rmhg krb5kdc[26787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533216, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:36.897109 26929 init.cc:377] Logged in from keytab as kudu/127.4.26.125@KRBTEST.COM (short username kudu)
I20260812 11:13:36.898945 26929 webserver.cc:460] Webserver started at http://127.4.26.125:44573/ using document root <none> and password file <none>
I20260812 11:13:36.899725 26929 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:36.899855 26929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:36.900170 26929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:13:36.903389 26929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/data/instance:
uuid: "1f2c9edd85824ec0b45a0fccf92680e5"
format_stamp: "Formatted at 2026-08-12 11:13:36 on dist-test-slave-rmhg"
server_key: "d7844d0954ef074ab323ea76d3e7b7e4"
server_key_iv: "67d306259f944823fd38a9d6469207a5"
server_key_version: "encryptionkey@0"
I20260812 11:13:36.904315 26929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/wal/instance:
uuid: "1f2c9edd85824ec0b45a0fccf92680e5"
format_stamp: "Formatted at 2026-08-12 11:13:36 on dist-test-slave-rmhg"
server_key: "d7844d0954ef074ab323ea76d3e7b7e4"
server_key_iv: "67d306259f944823fd38a9d6469207a5"
server_key_version: "encryptionkey@0"
I20260812 11:13:36.910135 26929 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 11:13:36.914125 26960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:36.915796 26929 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:13:36.916021 26929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/wal
uuid: "1f2c9edd85824ec0b45a0fccf92680e5"
format_stamp: "Formatted at 2026-08-12 11:13:36 on dist-test-slave-rmhg"
server_key: "d7844d0954ef074ab323ea76d3e7b7e4"
server_key_iv: "67d306259f944823fd38a9d6469207a5"
server_key_version: "encryptionkey@0"
I20260812 11:13:36.916237 26929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:36.957690 26929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:36.962610 26929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:36.962919 26929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:36.981985 26929 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.125:34881
I20260812 11:13:36.981995 27046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.125:34881 every 8 connection(s)
I20260812 11:13:36.983423 26929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/data/info.pb
I20260812 11:13:36.985436 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 26929
I20260812 11:13:36.985651 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-1/wal/instance
I20260812 11:13:36.986231 4201 external_mini_cluster.cc:1428] Setting key fdae67237ec52d609909c05cf9cd9dce
I20260812 11:13:36.988200 27048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:13:36.997452 27048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:13:37 dist-test-slave-rmhg krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533216, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.125@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.26.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.124@KRBTEST.COM" created.
I20260812 11:13:37.024065 27055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.000557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45878 (local address 127.4.26.126:35485)
0812 11:13:37.001054 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:37.001061 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:37.002423 (+ 1362us) server_negotiation.cc:407] Connection header received
0812 11:13:37.005081 (+ 2658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:37.005087 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:37.005210 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:37.005335 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:37.007852 (+ 2517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.008616 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.011132 (+ 2516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.011618 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.011742 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.016621 (+ 4879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:37.016627 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:37.016631 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:37.016686 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:37.020142 (+ 3456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.021454 (+ 1312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.021461 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.021465 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.021658 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.022134 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.022138 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.022141 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.022531 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:37.022678 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:37.023463 (+ 785us) server_negotiation.cc:299] Negotiation successful
0812 11:13:37.023716 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":262,"threads_started":1}
I20260812 11:13:37.024987 27058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.001316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:35485 (local address 127.0.0.1:45878)
0812 11:13:37.002232 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.002274 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:37.004567 (+ 2293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:37.005750 (+ 1183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:37.005764 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:37.006738 (+ 974us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:37.007629 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:37.007659 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.008800 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.008805 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:37.010903 (+ 2098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:37.010923 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.011908 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.011917 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:37.012321 (+ 404us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.013138 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:37.013218 (+ 80us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:37.016278 (+ 3060us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:37.020436 (+ 4158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:37.020448 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:37.020477 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:37.021281 (+ 804us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:37.021779 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:37.021783 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:37.021786 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:37.022004 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:37.022660 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:37.022667 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:37.023063 (+ 396us) client_negotiation.cc:769] Sending connection context
0812 11:13:37.023324 (+ 261us) client_negotiation.cc:240] Negotiation successful
0812 11:13:37.023791 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":406,"threads_started":1}
I20260812 11:13:37.026906 27048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:13:37 dist-test-slave-rmhg krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533216, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.125@KRBTEST.COM for kudu/127.4.26.125@KRBTEST.COM
I20260812 11:13:37.043740 27058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.027592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:34881 (local address 127.0.0.1:56160)
0812 11:13:37.028570 (+ 978us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.028594 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:37.028712 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:37.029261 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:37.029265 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:37.029719 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:37.029867 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:37.029876 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.031817 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.031822 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:37.032734 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:37.032748 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.033979 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.033983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:37.034175 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.034766 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:37.034784 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:37.036896 (+ 2112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:37.040952 (+ 4056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:37.040956 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:37.040959 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:37.041391 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:37.041837 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:37.041841 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:37.041843 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:37.041987 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:37.042803 (+ 816us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:37.042809 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:37.043018 (+ 209us) client_negotiation.cc:769] Sending connection context
0812 11:13:37.043147 (+ 129us) client_negotiation.cc:240] Negotiation successful
0812 11:13:37.043405 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":862}
I20260812 11:13:37.044124 27059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.027878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56160 (local address 127.4.26.125:34881)
0812 11:13:37.028620 (+ 742us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:37.028627 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:37.028660 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:13:37.028827 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:37.028834 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:37.029048 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:37.029241 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:37.030035 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.031626 (+ 1591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.032892 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.033808 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.033935 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.037144 (+ 3209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:37.037198 (+ 54us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:37.037219 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:37.037261 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:37.040785 (+ 3524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.041533 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.041543 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.041546 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.041712 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.042093 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.042097 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.042100 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.042629 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:37.042859 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:37.043347 (+ 488us) server_negotiation.cc:299] Negotiation successful
0812 11:13:37.043631 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":389,"threads_started":1}
I20260812 11:13:37.046710 27048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:13:37.047827 27058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.047304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:37896)
0812 11:13:37.047480 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.047656 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260812 11:13:37.048107 26965 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
I20260812 11:13:37.049793 27058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.049445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:37912)
0812 11:13:37.049608 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.049685 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260812 11:13:37.050076 27048 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:33653: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.124.keytab.
Entry for principal kudu/127.4.26.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.124.keytab.
I20260812 11:13:37.055904 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.124:33653
--webserver_interface=127.4.26.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.124.keytab
--principal=kudu/127.4.26.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:33253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:35485,127.4.26.125:34881,127.4.26.124:33653
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:13:37.099406 27048 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } attempt: 1
I20260812 11:13:37.100669 27058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.100174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:37920)
0812 11:13:37.100387 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.100506 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260812 11:13:37.101814 27058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.101422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:37928)
0812 11:13:37.101610 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.101700 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 11:13:37.102036 27048 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:33653: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
I20260812 11:13:37.152486 26918 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } attempt: 5
Aug 12 11:13:37 dist-test-slave-rmhg krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533216, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for kudu/127.4.26.125@KRBTEST.COM
I20260812 11:13:37.168092 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.153331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:34881 (local address 127.0.0.1:56162)
0812 11:13:37.153562 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.153584 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:37.153707 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:37.154179 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:37.154183 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:37.154603 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:37.154844 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:37.154856 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.156312 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.156316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:37.157350 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:37.157366 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.158388 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.158393 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:37.158552 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.159254 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:37.159275 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:37.161472 (+ 2197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:37.165427 (+ 3955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:37.165433 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:37.165436 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:37.165924 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:37.166402 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:37.166406 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:37.166408 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:37.166556 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:37.167251 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:37.167255 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:37.167402 (+ 147us) client_negotiation.cc:769] Sending connection context
0812 11:13:37.167562 (+ 160us) client_negotiation.cc:240] Negotiation successful
0812 11:13:37.167798 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260812 11:13:37.168259 27059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.153412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56162 (local address 127.4.26.125:34881)
0812 11:13:37.153690 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:37.153697 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:37.153721 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:13:37.153818 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:37.153824 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:37.153931 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:37.154087 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:37.155048 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.156152 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.157503 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.158215 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.158358 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.161717 (+ 3359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:37.161725 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:37.161729 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:37.161774 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:37.165136 (+ 3362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.166133 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.166137 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.166140 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.166278 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.166706 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.166713 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.166716 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.167118 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:37.167270 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:37.167708 (+ 438us) server_negotiation.cc:299] Negotiation successful
0812 11:13:37.167947 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
I20260812 11:13:37.169365 26918 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:13:37.170262 27048 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } attempt: 2
I20260812 11:13:37.170579 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.170056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:37936)
0812 11:13:37.170292 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.170397 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260812 11:13:37.171240 27058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.170778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:37946)
0812 11:13:37.171022 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.171107 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260812 11:13:37.171569 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.171175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:37954)
0812 11:13:37.171335 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.171434 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260812 11:13:37.171765 26918 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:33653: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
I20260812 11:13:37.172199 27058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.171875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:37958)
0812 11:13:37.172018 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.172087 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260812 11:13:37.172387 27048 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:33653: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
I20260812 11:13:37.222998 26918 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } attempt: 1
I20260812 11:13:37.224262 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.223736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:37966)
0812 11:13:37.223961 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.224081 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260812 11:13:37.225317 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.224926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:37972)
0812 11:13:37.225082 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.225191 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 11:13:37.225517 26918 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:33653: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
I20260812 11:13:37.263640 27048 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } attempt: 3
I20260812 11:13:37.264997 27058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.264412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:37976)
0812 11:13:37.264728 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.264827 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
I20260812 11:13:37.266275 27058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.265809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:37986)
0812 11:13:37.266040 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.266143 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
W20260812 11:13:37.266505 27048 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:33653: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
I20260812 11:13:37.293759 26918 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } attempt: 2
I20260812 11:13:37.294963 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.294450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:38000)
0812 11:13:37.294700 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.294800 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 11:13:37.295964 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.295612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:38004)
0812 11:13:37.295764 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.295841 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 11:13:37.296172 26918 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:33653: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
I20260812 11:13:37.402408 26918 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } attempt: 3
I20260812 11:13:37.403981 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.403249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:38016)
0812 11:13:37.403635 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.403757 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
I20260812 11:13:37.405273 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.404802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:38022)
0812 11:13:37.404984 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.405085 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 11:13:37.405553 26918 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:33653: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
I20260812 11:13:37.409727 27048 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } attempt: 4
I20260812 11:13:37.410853 27058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.410337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:38028)
0812 11:13:37.410609 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.410701 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260812 11:13:37.411684 27067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
I20260812 11:13:37.411937 27058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.411538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:38044)
0812 11:13:37.411712 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.411786 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260812 11:13:37.412014 27067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:37.412143 27048 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:33653: Network error: Client connection negotiation failed: client connection to 127.4.26.124:33653: connect: Connection refused (error 111)
W20260812 11:13:37.412181 27067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:37.419697 27067 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:13:37.419843 27067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:37.419924 27067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:37.420013 27067 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:13:37.420075 27067 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:13:37.430567 27067 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:33253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:35485,127.4.26.125:34881,127.4.26.124:33653
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.124.keytab
--principal=kudu/127.4.26.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.124:33653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.26.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:37.432040 27067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:37.433486 27067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:37.446905 27074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:37.447211 27073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:37.447033 27078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:37.451036 27067 server_base.cc:1034] running on GCE node
I20260812 11:13:37.451932 27067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:37.453621 27067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:37.454865 27067 hybrid_clock.cc:648] HybridClock initialized: now 1786533217454807 us; error 54 us; skew 500 ppm
I20260812 11:13:37.455276 27067 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:37 dist-test-slave-rmhg krb5kdc[26787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533217, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:37.458763 27067 init.cc:377] Logged in from keytab as kudu/127.4.26.124@KRBTEST.COM (short username kudu)
I20260812 11:13:37.460613 27067 webserver.cc:460] Webserver started at http://127.4.26.124:34781/ using document root <none> and password file <none>
I20260812 11:13:37.461522 27067 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:37.461663 27067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:37.462002 27067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:13:37.465345 27067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/data/instance:
uuid: "57360ca3e4d84207b4c847c48362c104"
format_stamp: "Formatted at 2026-08-12 11:13:37 on dist-test-slave-rmhg"
server_key: "48af347026f0f82b87379b017f9ccfc6"
server_key_iv: "0c0b75cc892ebb427504d324dee2a57b"
server_key_version: "encryptionkey@0"
I20260812 11:13:37.466339 27067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/wal/instance:
uuid: "57360ca3e4d84207b4c847c48362c104"
format_stamp: "Formatted at 2026-08-12 11:13:37 on dist-test-slave-rmhg"
server_key: "48af347026f0f82b87379b017f9ccfc6"
server_key_iv: "0c0b75cc892ebb427504d324dee2a57b"
server_key_version: "encryptionkey@0"
I20260812 11:13:37.472157 27067 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260812 11:13:37.476141 27089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:37.477744 27067 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:13:37.477936 27067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/wal
uuid: "57360ca3e4d84207b4c847c48362c104"
format_stamp: "Formatted at 2026-08-12 11:13:37 on dist-test-slave-rmhg"
server_key: "48af347026f0f82b87379b017f9ccfc6"
server_key_iv: "0c0b75cc892ebb427504d324dee2a57b"
server_key_version: "encryptionkey@0"
I20260812 11:13:37.478145 27067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:37.496490 27067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:37.501551 27067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:37.501870 27067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:37.521894 27067 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.124:33653
I20260812 11:13:37.521929 27180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.124:33653 every 8 connection(s)
I20260812 11:13:37.523411 27067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/data/info.pb
I20260812 11:13:37.524513 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 27067
I20260812 11:13:37.524720 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786532997575371-4201-0/minicluster-data/master-2/wal/instance
I20260812 11:13:37.525246 4201 external_mini_cluster.cc:1428] Setting key 62851e5a0cdad201ad1db12b55b6e5ec
I20260812 11:13:37.528256 27182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:13:37.537290 27182 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:13:37 dist-test-slave-rmhg krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.124@KRBTEST.COM
Aug 12 11:13:37 dist-test-slave-rmhg krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533217, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.124@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:13:37.551457 27187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.527362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38052 (local address 127.4.26.124:33653)
0812 11:13:37.528257 (+ 895us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:37.528271 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:37.528319 (+ 48us) server_negotiation.cc:407] Connection header received
0812 11:13:37.530100 (+ 1781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:37.530130 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:37.530581 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:37.530986 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:37.533044 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.534597 (+ 1553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.536625 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.537478 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.537707 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.543157 (+ 5450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:37.543174 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:37.543196 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:37.543251 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:37.546871 (+ 3620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.547722 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.547730 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.547737 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.547921 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.548354 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.548358 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.548363 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.548986 (+ 623us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:37.549291 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:37.549834 (+ 543us) server_negotiation.cc:299] Negotiation successful
0812 11:13:37.550349 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":663,"thread_start_us":419,"threads_started":1}
I20260812 11:13:37.557225 27190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.540772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45892 (local address 127.4.26.126:35485)
0812 11:13:37.542322 (+ 1550us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:37.542327 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:37.542349 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:13:37.542418 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:37.542423 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:37.542521 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:37.542650 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:37.544568 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.545429 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.547053 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.547478 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.547609 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.550876 (+ 3267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:37.550882 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:37.550886 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:37.550921 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:37.553876 (+ 2955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.554812 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.554818 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.554822 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.555056 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.555509 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.555519 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.555522 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.555937 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:37.556099 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:37.556699 (+ 600us) server_negotiation.cc:299] Negotiation successful
0812 11:13:37.556880 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1414,"thread_start_us":1235,"threads_started":1}
I20260812 11:13:37.557452 27189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.540676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:35485 (local address 127.0.0.1:45892)
0812 11:13:37.541488 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.541571 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:37.541781 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:37.542747 (+ 966us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:37.542755 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:37.543862 (+ 1107us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:37.544253 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:37.544268 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.545620 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.545625 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:37.546886 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:37.546902 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.547673 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.547679 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:37.547851 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.548439 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:37.548457 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:37.550663 (+ 2206us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:37.554047 (+ 3384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:37.554057 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:37.554062 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:37.554667 (+ 605us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:37.555211 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:37.555216 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:37.555220 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:37.555372 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:37.556106 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:37.556113 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:37.556352 (+ 239us) client_negotiation.cc:769] Sending connection context
0812 11:13:37.556609 (+ 257us) client_negotiation.cc:240] Negotiation successful
0812 11:13:37.556984 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":296,"threads_started":1}
I20260812 11:13:37.558990 27182 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:13:37 dist-test-slave-rmhg krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
Aug 12 11:13:37 dist-test-slave-rmhg krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533217, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.124@KRBTEST.COM for kudu/127.4.26.125@KRBTEST.COM
I20260812 11:13:37.572314 27191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.555101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45906 (local address 127.4.26.126:35485)
0812 11:13:37.555981 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:37.555986 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:37.556010 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:13:37.556056 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:37.556061 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:37.556132 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:37.556216 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:37.558007 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.558927 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.560584 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.561016 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.561133 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.565608 (+ 4475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:37.565614 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:37.565618 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:37.565655 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:37.569325 (+ 3670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.570139 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.570145 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.570149 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.570283 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.570737 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.570742 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.570745 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.571164 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:37.571408 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:37.571721 (+ 313us) server_negotiation.cc:299] Negotiation successful
0812 11:13:37.571949 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":714,"thread_start_us":484,"threads_started":1}
I20260812 11:13:37.572721 27189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.559580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:34881 (local address 127.0.0.1:56176)
0812 11:13:37.559826 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.559846 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:37.559933 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:37.560295 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:37.560299 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:37.560710 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:37.560859 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:37.560868 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.561958 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.561962 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:37.562852 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:37.562866 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.563601 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.563607 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:37.563794 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.564340 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:37.564364 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:37.566391 (+ 2027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:37.570150 (+ 3759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:37.570154 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:37.570157 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:37.570643 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:37.571056 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:37.571059 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:37.571061 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:37.571201 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:37.571814 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:37.571819 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:37.572008 (+ 189us) client_negotiation.cc:769] Sending connection context
0812 11:13:37.572167 (+ 159us) client_negotiation.cc:240] Negotiation successful
0812 11:13:37.572395 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145}
I20260812 11:13:37.573563 27059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.559771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56176 (local address 127.4.26.125:34881)
0812 11:13:37.559965 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:37.559971 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:37.559989 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:13:37.560045 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:37.560050 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:37.560127 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:37.560233 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:37.561068 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.561814 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.563011 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.563445 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.563563 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.566649 (+ 3086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:37.566657 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:37.566662 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:37.566707 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:37.570004 (+ 3297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.570761 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.570766 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.570768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.570921 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.571321 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.571326 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.571329 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.571678 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:37.571828 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:37.573008 (+ 1180us) server_negotiation.cc:299] Negotiation successful
0812 11:13:37.573230 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 11:13:37.574522 27182 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:13:37 dist-test-slave-rmhg krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533217, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.124@KRBTEST.COM for kudu/127.4.26.124@KRBTEST.COM
I20260812 11:13:37.582744 26918 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } attempt: 4
Aug 12 11:13:37 dist-test-slave-rmhg krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533215, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.125@KRBTEST.COM
I20260812 11:13:37.590543 27189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.575133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:38054)
0812 11:13:37.575386 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.575402 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:37.575481 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:37.575802 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:37.575806 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:37.576205 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:37.576339 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:37.576347 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.577377 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.577381 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:37.578456 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:37.578482 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.579306 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.579312 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:37.579506 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.580121 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:37.580143 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:37.582856 (+ 2713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:37.587563 (+ 4707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:37.587569 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:37.587573 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:37.588082 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:37.588525 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:37.588531 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:37.588535 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:37.588730 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:37.589440 (+ 710us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:37.589447 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:37.589641 (+ 194us) client_negotiation.cc:769] Sending connection context
0812 11:13:37.589834 (+ 193us) client_negotiation.cc:240] Negotiation successful
0812 11:13:37.590171 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159}
I20260812 11:13:37.591310 27187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.575427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38054 (local address 127.4.26.124:33653)
0812 11:13:37.575587 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:37.575593 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:37.575608 (+ 15us) server_negotiation.cc:407] Connection header received
0812 11:13:37.575643 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:37.575645 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:37.575692 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:37.575767 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:37.576476 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.577230 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.578635 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.579127 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.579232 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.583544 (+ 4312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:37.583552 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:37.583557 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:37.583612 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:37.587381 (+ 3769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.588225 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.588231 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.588235 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.588396 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.588859 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.588864 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.588867 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.589303 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:37.589452 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:37.590869 (+ 1417us) server_negotiation.cc:299] Negotiation successful
0812 11:13:37.591078 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 12 11:13:37 dist-test-slave-rmhg krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533216, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for kudu/127.4.26.124@KRBTEST.COM
I20260812 11:13:37.593775 27059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.574141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56184 (local address 127.4.26.125:34881)
0812 11:13:37.574284 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:37.574289 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:37.574329 (+ 40us) server_negotiation.cc:407] Connection header received
0812 11:13:37.574943 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:37.574948 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:37.575025 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:37.575133 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:37.577269 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.578032 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.579551 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.580015 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.580129 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.585642 (+ 5513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:37.585650 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:37.585655 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:37.585702 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:37.588779 (+ 3077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.589811 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.589817 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.589821 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.590001 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.591769 (+ 1768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.591774 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.591778 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.592095 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:37.592381 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:37.593342 (+ 961us) server_negotiation.cc:299] Negotiation successful
0812 11:13:37.593548 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260812 11:13:37.597920 27182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104: Bootstrap starting.
I20260812 11:13:37.600188 26924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.583410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:38068)
0812 11:13:37.583722 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.583744 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:37.583877 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:37.584853 (+ 976us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:37.584859 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:37.585346 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:37.585818 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:37.585843 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.587635 (+ 1792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.587641 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:37.588738 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:37.588755 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.589742 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.589748 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:37.589937 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.590528 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:37.590546 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:37.593043 (+ 2497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:37.597085 (+ 4042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:37.597090 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:37.597093 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:37.597773 (+ 680us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:37.598253 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:37.598258 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:37.598262 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:37.598409 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:37.599103 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:37.599108 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:37.599304 (+ 196us) client_negotiation.cc:769] Sending connection context
0812 11:13:37.599455 (+ 151us) client_negotiation.cc:240] Negotiation successful
0812 11:13:37.599792 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183}
I20260812 11:13:37.600337 27193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.583458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38068 (local address 127.4.26.124:33653)
0812 11:13:37.584512 (+ 1054us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:37.584519 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:37.584541 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:13:37.584598 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:37.584602 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:37.584679 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:37.584792 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:37.586089 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.587469 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.588898 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.589589 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.589702 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.593351 (+ 3649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:37.593357 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:37.593361 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:37.593397 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:37.596898 (+ 3501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.597945 (+ 1047us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.597951 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.597955 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.598127 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.598543 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.598562 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.598566 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.598974 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:37.599125 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:37.599635 (+ 510us) server_negotiation.cc:299] Negotiation successful
0812 11:13:37.599898 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":905,"thread_start_us":666,"threads_started":1}
I20260812 11:13:37.601260 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:13:37.602169 27182 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104: Neither blocks nor log segments found. Creating new log.
I20260812 11:13:37.603240 27182 log.cc:824] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:37.606971 27182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104: No bootstrap required, opened a new log
I20260812 11:13:37.608777 26918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a: Bootstrap starting.
I20260812 11:13:37.613262 26918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a: Neither blocks nor log segments found. Creating new log.
I20260812 11:13:37.614648 26918 log.cc:824] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:37.617945 27182 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } }
I20260812 11:13:37.618469 27182 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:13:37.618607 27182 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57360ca3e4d84207b4c847c48362c104, State: Initialized, Role: FOLLOWER
I20260812 11:13:37.619375 27182 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } }
I20260812 11:13:37.624867 26918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a: No bootstrap required, opened a new log
I20260812 11:13:37.637651 26918 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } }
I20260812 11:13:37.638172 26918 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:13:37.638288 26918 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69bbb0959ff5467091252f216c07fb6a, State: Initialized, Role: FOLLOWER
I20260812 11:13:37.639586 27204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } } }
I20260812 11:13:37.640120 27204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:13:37.640370 27191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.611558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45922 (local address 127.4.26.126:35485)
0812 11:13:37.611773 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:37.611780 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:37.612279 (+ 499us) server_negotiation.cc:407] Connection header received
0812 11:13:37.612603 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:37.612608 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:37.612698 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:37.612779 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:37.615869 (+ 3090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.617205 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.619438 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.620216 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.620359 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.627805 (+ 7446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:37.627813 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:37.627819 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:37.627871 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:37.632208 (+ 4337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.636572 (+ 4364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.636580 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.636584 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.636802 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.637388 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.637394 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.637398 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.637788 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:37.638087 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:37.638682 (+ 595us) server_negotiation.cc:299] Negotiation successful
0812 11:13:37.638952 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:13:37.640736 26918 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } }
I20260812 11:13:37.641089 27182 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:13:37.648100 27207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } } }
I20260812 11:13:37.648582 27207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:13:37.650810 26918 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:13:37.650996 27193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.625477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38084 (local address 127.4.26.124:33653)
0812 11:13:37.625673 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:37.625679 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:37.632452 (+ 6773us) server_negotiation.cc:407] Connection header received
0812 11:13:37.632959 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:37.632966 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:37.633097 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:37.633213 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:37.635060 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.636132 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.638059 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.638722 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.638825 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.643133 (+ 4308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:37.643140 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:37.643145 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:37.643189 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:37.646771 (+ 3582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.647663 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.647669 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.647672 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.647820 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.648335 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.648341 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.648344 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.648750 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:37.649041 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:37.650317 (+ 1276us) server_negotiation.cc:299] Negotiation successful
0812 11:13:37.650555 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:13:37.654562 27059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.613135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56188 (local address 127.4.26.125:34881)
0812 11:13:37.613372 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:37.613378 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:37.625078 (+ 11700us) server_negotiation.cc:407] Connection header received
0812 11:13:37.625397 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:37.625403 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:37.625500 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:37.625576 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:37.633335 (+ 7759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.634528 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.641007 (+ 6479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.641737 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.641858 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.647381 (+ 5523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:37.647390 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:37.647395 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:37.647445 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:37.651068 (+ 3623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.652003 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.652009 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.652013 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.652202 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.652739 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.652745 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.652747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.653130 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:37.653412 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:37.653967 (+ 555us) server_negotiation.cc:299] Negotiation successful
0812 11:13:37.654202 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125}
W20260812 11:13:37.674499 26841 tablet.cc:2369] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:13:37.663686 26806 master_runner.cc:186] Error getting master registration for 127.4.26.125:34881: OK, instance_id { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" instance_seqno: 1786533216976321 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:13:37.676859 26806 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 11:13:37.680246 27243 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:13:37.680562 27243 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 11:13:37.683640 27232 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:13:37.683782 27232 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:13:37.671485 27067 master_runner.cc:186] Error getting master registration for 127.4.26.125:34881: OK, instance_id { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" instance_seqno: 1786533216976321 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:13:37.685873 27067 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:13:37.711369 27048 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } attempt: 5
Aug 12 11:13:37 dist-test-slave-rmhg krb5kdc[26787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533216, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.125@KRBTEST.COM for kudu/127.4.26.124@KRBTEST.COM
I20260812 11:13:37.730804 27058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.712120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:33653 (local address 127.0.0.1:38088)
0812 11:13:37.712404 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:37.712426 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:37.712562 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:37.712949 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:37.712954 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:37.713552 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:37.713776 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:37.713791 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.715342 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.715348 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:37.716857 (+ 1509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:37.716878 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.718316 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.718324 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:37.718536 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.720142 (+ 1606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:37.720167 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:37.723178 (+ 3011us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:37.727600 (+ 4422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:37.727607 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:37.727611 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:37.728220 (+ 609us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:37.728711 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:37.728717 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:37.728721 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:37.728906 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:37.729654 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:37.729660 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:37.729849 (+ 189us) client_negotiation.cc:769] Sending connection context
0812 11:13:37.730022 (+ 173us) client_negotiation.cc:240] Negotiation successful
0812 11:13:37.730386 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161}
I20260812 11:13:37.730834 27193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:37.712197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38088 (local address 127.4.26.124:33653)
0812 11:13:37.712398 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:37.712404 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:37.712475 (+ 71us) server_negotiation.cc:407] Connection header received
0812 11:13:37.712696 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:37.712702 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:37.712785 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:37.712909 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:37.713960 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.715159 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.717079 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:37.717877 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:37.718020 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:37.723425 (+ 5405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:37.723432 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:37.723438 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:37.723500 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:37.727400 (+ 3900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.728371 (+ 971us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.728378 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.728382 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.728574 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:37.729032 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:37.729037 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:37.729045 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:37.729497 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:37.729704 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:37.730177 (+ 473us) server_negotiation.cc:299] Negotiation successful
0812 11:13:37.730431 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:13:37.737637 27048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5: Bootstrap starting.
I20260812 11:13:37.742178 27048 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5: Neither blocks nor log segments found. Creating new log.
I20260812 11:13:37.743552 27048 log.cc:824] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:37.747213 27048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5: No bootstrap required, opened a new log
W20260812 11:13:37.754243 27099 tablet.cc:2369] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:13:37.758448 27048 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } }
I20260812 11:13:37.758929 27048 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:13:37.759059 27048 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f2c9edd85824ec0b45a0fccf92680e5, State: Initialized, Role: FOLLOWER
I20260812 11:13:37.759809 27048 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } }
I20260812 11:13:37.760942 27255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } } }
I20260812 11:13:37.761502 27255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:13:37.762307 27048 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:13:37.783737 26929 master_runner.cc:263] No leader master found from master 1f2c9edd85824ec0b45a0fccf92680e5
I20260812 11:13:37.783914 26929 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 11:13:37.787094 27272 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:13:37.787366 27272 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:13:37.952701 27204 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:13:37.953080 27204 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } }
I20260812 11:13:37.955178 27204 leader_election.cc:288] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69bbb0959ff5467091252f216c07fb6a (127.4.26.126:35485), 1f2c9edd85824ec0b45a0fccf92680e5 (127.4.26.125:34881)
I20260812 11:13:37.956671 27010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57360ca3e4d84207b4c847c48362c104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" is_pre_election: true
I20260812 11:13:37.957705 27010 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57360ca3e4d84207b4c847c48362c104 in term 0.
I20260812 11:13:37.958750 27093 leader_election.cc:302] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f2c9edd85824ec0b45a0fccf92680e5, 57360ca3e4d84207b4c847c48362c104; no voters:
I20260812 11:13:37.960067 26876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57360ca3e4d84207b4c847c48362c104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69bbb0959ff5467091252f216c07fb6a" is_pre_election: true
I20260812 11:13:37.960848 26876 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57360ca3e4d84207b4c847c48362c104 in term 0.
I20260812 11:13:37.962064 27204 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:13:37.962237 27204 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:13:37.962340 27204 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [term 0 FOLLOWER]: Advancing to term 1
W20260812 11:13:37.965951 26975 tablet.cc:2369] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:13:37.966184 27204 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } }
I20260812 11:13:37.967686 26876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57360ca3e4d84207b4c847c48362c104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69bbb0959ff5467091252f216c07fb6a"
I20260812 11:13:37.967990 26876 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:13:37.972481 26876 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57360ca3e4d84207b4c847c48362c104 in term 1.
I20260812 11:13:37.973223 27093 leader_election.cc:302] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57360ca3e4d84207b4c847c48362c104, 69bbb0959ff5467091252f216c07fb6a; no voters:
I20260812 11:13:37.976373 27204 leader_election.cc:288] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [CANDIDATE]: Term 1 election: Requested vote from peers 69bbb0959ff5467091252f216c07fb6a (127.4.26.126:35485), 1f2c9edd85824ec0b45a0fccf92680e5 (127.4.26.125:34881)
I20260812 11:13:37.977566 27204 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:13:37.978123 27204 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [term 1 LEADER]: Becoming Leader. State: Replica: 57360ca3e4d84207b4c847c48362c104, State: Running, Role: LEADER
I20260812 11:13:37.979269 27204 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } }
I20260812 11:13:37.991566 27010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "57360ca3e4d84207b4c847c48362c104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f2c9edd85824ec0b45a0fccf92680e5"
I20260812 11:13:37.991878 27010 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:13:37.995872 27010 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57360ca3e4d84207b4c847c48362c104 in term 1.
I20260812 11:13:38.003067 27279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57360ca3e4d84207b4c847c48362c104. Latest consensus state: current_term: 1 leader_uuid: "57360ca3e4d84207b4c847c48362c104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } } }
I20260812 11:13:38.003919 27279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [sys.catalog]: This master's current role is: LEADER
I20260812 11:13:38.014926 27282 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:13:38.017565 27282 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:13:38.039286 27010 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5 [term 1 FOLLOWER]: Refusing update from remote peer 57360ca3e4d84207b4c847c48362c104: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:13:38.040437 27279 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:13:38.048692 26876 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a [term 1 FOLLOWER]: Refusing update from remote peer 57360ca3e4d84207b4c847c48362c104: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:13:38.049948 27279 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:13:38.074803 27207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57360ca3e4d84207b4c847c48362c104. Latest consensus state: current_term: 1 leader_uuid: "57360ca3e4d84207b4c847c48362c104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } } }
I20260812 11:13:38.075209 27207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:13:38.081240 27291 mvcc.cc:205] Tried to move back new op lower bound from 7317640061074456576 to 7317640060877795328. Current Snapshot: MvccSnapshot[applied={T|T < 7317640061074456576}]
I20260812 11:13:38.092096 27255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57360ca3e4d84207b4c847c48362c104. Latest consensus state: current_term: 1 leader_uuid: "57360ca3e4d84207b4c847c48362c104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } } }
I20260812 11:13:38.092444 27255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:13:38.093139 27282 catalog_manager.cc:1347] Generated new cluster ID: 79c0574fe9a74e2cb16fd4d111014ab7
I20260812 11:13:38.093283 27282 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:13:38.099406 27207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "57360ca3e4d84207b4c847c48362c104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } } }
I20260812 11:13:38.099700 27207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:13:38.100631 27204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "57360ca3e4d84207b4c847c48362c104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } } }
I20260812 11:13:38.100947 27204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [sys.catalog]: This master's current role is: LEADER
I20260812 11:13:38.106783 27279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "57360ca3e4d84207b4c847c48362c104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } } }
I20260812 11:13:38.107105 27279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 [sys.catalog]: This master's current role is: LEADER
I20260812 11:13:38.107767 27288 mvcc.cc:205] Tried to move back new op lower bound from 7317640061074456576 to 7317640060877795328. Current Snapshot: MvccSnapshot[applied={T|T < 7317640061074456576}]
I20260812 11:13:38.121626 27282 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:13:38.123662 27282 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:13:38.137639 27255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "57360ca3e4d84207b4c847c48362c104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69bbb0959ff5467091252f216c07fb6a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 35485 } } peers { permanent_uuid: "1f2c9edd85824ec0b45a0fccf92680e5" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 34881 } } peers { permanent_uuid: "57360ca3e4d84207b4c847c48362c104" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 33653 } } }
I20260812 11:13:38.137989 27255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:13:38.178191 27282 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104: Generated new TSK 0
I20260812 11:13:38.179461 27282 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:13:38.682928 27243 catalog_manager.cc:1259] Loaded cluster ID: 79c0574fe9a74e2cb16fd4d111014ab7
I20260812 11:13:38.683065 27243 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a: loading cluster ID for follower catalog manager: success
I20260812 11:13:38.685696 27243 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a: acquiring CA information for follower catalog manager: success
I20260812 11:13:38.687490 27243 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 69bbb0959ff5467091252f216c07fb6a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:13:38.789595 27272 catalog_manager.cc:1259] Loaded cluster ID: 79c0574fe9a74e2cb16fd4d111014ab7
I20260812 11:13:38.789708 27272 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5: loading cluster ID for follower catalog manager: success
I20260812 11:13:38.792208 27272 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5: acquiring CA information for follower catalog manager: success
I20260812 11:13:38.794515 27272 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1f2c9edd85824ec0b45a0fccf92680e5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:13:39.278617 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 26806
I20260812 11:13:39.280432 26913 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:39.391769 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 26806
I20260812 11:13:39.417585 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 26929
I20260812 11:13:39.418735 27041 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:39.527655 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 26929
I20260812 11:13:39.537288 27317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:39.535468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:35485 (local address 127.0.0.1:45928)
0812 11:13:39.536942 (+ 1474us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:39.537083 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:35485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1360,"thread_start_us":1263,"threads_started":1}
W20260812 11:13:39.537616 27093 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.26.126:35485: connect: Connection refused (error 111)
I20260812 11:13:39.539592 27317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:39.539196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:35485 (local address 127.0.0.1:45930)
0812 11:13:39.539357 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:39.539459 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:35485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 11:13:39.539824 27093 consensus_peers.cc:487] T 00000000000000000000000000000000 P 57360ca3e4d84207b4c847c48362c104 -> Peer 69bbb0959ff5467091252f216c07fb6a (127.4.26.126:35485): Couldn't send request to peer 69bbb0959ff5467091252f216c07fb6a. Status: Network error: Client connection negotiation failed: client connection to 127.4.26.126:35485: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 11:13:39.557657 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 27067
I20260812 11:13:39.558849 27175 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:39.669128 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 27067
2026-08-12T11:13:39Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5259 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:13:39 dist-test-slave-rmhg krb5kdc[27326](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:13:39 dist-test-slave-rmhg krb5kdc[27326](info): set up 2 sockets
Aug 12 11:13:39 dist-test-slave-rmhg krb5kdc[27326](info): commencing operation
krb5kdc: starting...
W20260812 11:13:40.947466 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.229s user 0.005s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:13:41 dist-test-slave-rmhg krb5kdc[27326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:13:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:13:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:13:41.244270 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:40569
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:42645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:40569
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:13:41.594122 27345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:41.594487 27345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:41.594635 27345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:41.602154 27345 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:13:41.602294 27345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:41.602377 27345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:41.602460 27345 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:13:41.602521 27345 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:13:41.613207 27345 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:42645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:40569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:40569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:41.614697 27345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:41.616076 27345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:41.628616 27358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:41.628677 27353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:41.628650 27354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:41.629904 27345 server_base.cc:1034] running on GCE node
I20260812 11:13:41.630800 27345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:41.632334 27345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:41.633563 27345 hybrid_clock.cc:648] HybridClock initialized: now 1786533221633521 us; error 67 us; skew 500 ppm
I20260812 11:13:41.633957 27345 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:41 dist-test-slave-rmhg krb5kdc[27326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533221, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:41.642588 27345 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:13:41.644465 27345 webserver.cc:460] Webserver started at http://127.4.26.126:45285/ using document root <none> and password file <none>
I20260812 11:13:41.645273 27345 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:41.645401 27345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:41.645784 27345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:13:41.649188 27345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "ed147d7ea83c46faabfd8537b47836cc"
format_stamp: "Formatted at 2026-08-12 11:13:41 on dist-test-slave-rmhg"
server_key: "8c6735769c6d6aae9014cffc9519ead0"
server_key_iv: "377f7c9b2c1a8743e949fee82d7b8b0f"
server_key_version: "encryptionkey@0"
I20260812 11:13:41.650094 27345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "ed147d7ea83c46faabfd8537b47836cc"
format_stamp: "Formatted at 2026-08-12 11:13:41 on dist-test-slave-rmhg"
server_key: "8c6735769c6d6aae9014cffc9519ead0"
server_key_iv: "377f7c9b2c1a8743e949fee82d7b8b0f"
server_key_version: "encryptionkey@0"
I20260812 11:13:41.656252 27345 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260812 11:13:41.660180 27368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:41.661746 27345 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:13:41.661947 27345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "ed147d7ea83c46faabfd8537b47836cc"
format_stamp: "Formatted at 2026-08-12 11:13:41 on dist-test-slave-rmhg"
server_key: "8c6735769c6d6aae9014cffc9519ead0"
server_key_iv: "377f7c9b2c1a8743e949fee82d7b8b0f"
server_key_version: "encryptionkey@0"
I20260812 11:13:41.662168 27345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:41.686966 27345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:41.691668 27345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:41.691974 27345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:41.710824 27345 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:40569
I20260812 11:13:41.710855 27463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:40569 every 8 connection(s)
I20260812 11:13:41.712265 27345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:13:41.713675 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 27345
I20260812 11:13:41.713908 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:13:41.714782 4201 external_mini_cluster.cc:1428] Setting key a64d1f5cb6474084ba3ee5d6bf33c0fa
I20260812 11:13:41.717219 27467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 11:13:41 dist-test-slave-rmhg krb5kdc[27326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533221, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:13:41.730718 27467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc: Bootstrap starting.
I20260812 11:13:41.734790 27467 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc: Neither blocks nor log segments found. Creating new log.
I20260812 11:13:41.736256 27467 log.cc:824] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:41.740163 27467 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc: No bootstrap required, opened a new log
I20260812 11:13:41.741485 27471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:41.716838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48472 (local address 127.4.26.126:40569)
0812 11:13:41.717697 (+ 859us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:41.717710 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:41.717754 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:13:41.719485 (+ 1731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:41.719511 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:41.719924 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:41.720274 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:41.722347 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:41.723814 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:41.725771 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:41.726517 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:41.726686 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:41.731785 (+ 5099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:41.731797 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:41.731817 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:41.731874 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:41.735831 (+ 3957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:41.736818 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:41.736835 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:41.736846 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:41.737080 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:41.737674 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:41.737681 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:41.737684 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:41.738565 (+ 881us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:41.738902 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:41.739379 (+ 477us) server_negotiation.cc:299] Negotiation successful
0812 11:13:41.739948 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":377,"threads_started":1}
I20260812 11:13:41.746181 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:13:41.749490 27467 raft_consensus.cc:348] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed147d7ea83c46faabfd8537b47836cc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40569 } }
I20260812 11:13:41.749902 27467 raft_consensus.cc:374] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:13:41.750005 27467 raft_consensus.cc:729] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed147d7ea83c46faabfd8537b47836cc, State: Initialized, Role: FOLLOWER
I20260812 11:13:41.750566 27467 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed147d7ea83c46faabfd8537b47836cc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40569 } }
I20260812 11:13:41.750792 27467 raft_consensus.cc:388] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:13:41.750922 27467 raft_consensus.cc:482] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:13:41.751083 27467 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:13:41.753507 27467 raft_consensus.cc:504] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed147d7ea83c46faabfd8537b47836cc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40569 } }
I20260812 11:13:41.754070 27467 leader_election.cc:302] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed147d7ea83c46faabfd8537b47836cc; no voters:
I20260812 11:13:41.754732 27467 leader_election.cc:288] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:13:41.754889 27475 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:13:41.755666 27475 raft_consensus.cc:686] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [term 1 LEADER]: Becoming Leader. State: Replica: ed147d7ea83c46faabfd8537b47836cc, State: Running, Role: LEADER
I20260812 11:13:41.756276 27475 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed147d7ea83c46faabfd8537b47836cc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40569 } }
I20260812 11:13:41.756946 27467 sys_catalog.cc:564] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:13:41.759585 27477 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed147d7ea83c46faabfd8537b47836cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed147d7ea83c46faabfd8537b47836cc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40569 } } }
I20260812 11:13:41.759629 27478 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed147d7ea83c46faabfd8537b47836cc. Latest consensus state: current_term: 1 leader_uuid: "ed147d7ea83c46faabfd8537b47836cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed147d7ea83c46faabfd8537b47836cc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 40569 } } }
I20260812 11:13:41.760020 27478 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [sys.catalog]: This master's current role is: LEADER
I20260812 11:13:41.760023 27477 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc [sys.catalog]: This master's current role is: LEADER
I20260812 11:13:41.761791 27487 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:13:41.766857 27487 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:13:41.776105 27487 catalog_manager.cc:1347] Generated new cluster ID: 06d3d14a298e40b79483f0d7e19623d9
I20260812 11:13:41.776242 27487 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:13:41.790316 27487 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:13:41.792542 27487 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:13:41.819837 27487 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ed147d7ea83c46faabfd8537b47836cc: Generated new TSK 0
I20260812 11:13:41.821074 27487 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:13:41.858466 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 27345
I20260812 11:13:41.859807 27452 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:41.956542 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 27345
2026-08-12T11:13:41Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2282 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:13:42 dist-test-slave-rmhg krb5kdc[27512](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:13:42 dist-test-slave-rmhg krb5kdc[27512](info): set up 2 sockets
Aug 12 11:13:42 dist-test-slave-rmhg krb5kdc[27512](info): commencing operation
krb5kdc: starting...
W20260812 11:13:43.226346 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.003s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:13:43 dist-test-slave-rmhg krb5kdc[27512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:13:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:13:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:13:43.520895 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:43003
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:43003
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:13:43.878944 27536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:43.879261 27536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:43.879354 27536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:43.886787 27536 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:13:43.886920 27536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:43.886968 27536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:43.887024 27536 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:13:43.887068 27536 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:13:43.897315 27536 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:43003
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:43003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:43.898662 27536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:43.899967 27536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:43.912035 27543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:43.912035 27549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:43.912016 27544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:43.912781 27536 server_base.cc:1034] running on GCE node
I20260812 11:13:43.913784 27536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:43.915303 27536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:43.916525 27536 hybrid_clock.cc:648] HybridClock initialized: now 1786533223916466 us; error 58 us; skew 500 ppm
I20260812 11:13:43.916884 27536 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:43 dist-test-slave-rmhg krb5kdc[27512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533223, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:43.920125 27536 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:13:43.921661 27536 webserver.cc:460] Webserver started at http://127.4.26.126:44341/ using document root <none> and password file <none>
I20260812 11:13:43.922335 27536 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:43.922439 27536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:43.922700 27536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:13:43.925802 27536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "d4f4200d3ab347c1b41864c16c72b37c"
format_stamp: "Formatted at 2026-08-12 11:13:43 on dist-test-slave-rmhg"
server_key: "62e46ba06fecdb11ade5faaaaa7d8c86"
server_key_iv: "77b389e1bf4a86f2d3c5b10a72d4113a"
server_key_version: "encryptionkey@0"
I20260812 11:13:43.926555 27536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "d4f4200d3ab347c1b41864c16c72b37c"
format_stamp: "Formatted at 2026-08-12 11:13:43 on dist-test-slave-rmhg"
server_key: "62e46ba06fecdb11ade5faaaaa7d8c86"
server_key_iv: "77b389e1bf4a86f2d3c5b10a72d4113a"
server_key_version: "encryptionkey@0"
I20260812 11:13:43.932024 27536 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:13:43.935868 27562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:43.937440 27536 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 11:13:43.937618 27536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "d4f4200d3ab347c1b41864c16c72b37c"
format_stamp: "Formatted at 2026-08-12 11:13:43 on dist-test-slave-rmhg"
server_key: "62e46ba06fecdb11ade5faaaaa7d8c86"
server_key_iv: "77b389e1bf4a86f2d3c5b10a72d4113a"
server_key_version: "encryptionkey@0"
I20260812 11:13:43.937819 27536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:43.952816 27536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:43.957608 27536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:43.957916 27536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:43.978166 27536 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:43003
I20260812 11:13:43.978206 27644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:43003 every 8 connection(s)
I20260812 11:13:43.979821 27536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:13:43.980616 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 27536
I20260812 11:13:43.980845 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:13:43.981675 4201 external_mini_cluster.cc:1428] Setting key 48ce418a45c6f13b87cfd0808057a6ac
I20260812 11:13:43.984704 27646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:13:43.996804 27646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c: Bootstrap starting.
Aug 12 11:13:43 dist-test-slave-rmhg krb5kdc[27512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:13:44.000633 27646 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c: Neither blocks nor log segments found. Creating new log.
I20260812 11:13:44.001991 27646 log.cc:824] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:44.005998 27646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c: No bootstrap required, opened a new log
I20260812 11:13:44.007529 27651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:43.983890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45920 (local address 127.4.26.126:43003)
0812 11:13:43.984872 (+ 982us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:43.984891 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:43.984949 (+ 58us) server_negotiation.cc:407] Connection header received
0812 11:13:43.986709 (+ 1760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:43.986736 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:43.987195 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:43.987653 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:43.989259 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:43.990790 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:43.992365 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:43.993147 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:43.993442 (+ 295us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:43.998325 (+ 4883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:43.998336 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:43.998359 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:43.998424 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:44.002045 (+ 3621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:44.003132 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:44.003141 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:44.003149 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:44.003365 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:44.003863 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:44.003868 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:44.003871 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:44.004685 (+ 814us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:44.005026 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:44.005521 (+ 495us) server_negotiation.cc:299] Negotiation successful
0812 11:13:44.006050 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":701,"thread_start_us":424,"threads_started":1}
I20260812 11:13:44.015084 27646 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } }
I20260812 11:13:44.015482 27646 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:13:44.015581 27646 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4f4200d3ab347c1b41864c16c72b37c, State: Initialized, Role: FOLLOWER
I20260812 11:13:44.016109 27646 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } }
I20260812 11:13:44.016321 27646 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:13:44.016417 27646 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:13:44.016558 27646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:13:44.018782 27646 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } }
I20260812 11:13:44.019356 27646 leader_election.cc:302] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4f4200d3ab347c1b41864c16c72b37c; no voters:
I20260812 11:13:44.020025 27646 leader_election.cc:288] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:13:44.020164 27653 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:13:44.020890 27653 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 1 LEADER]: Becoming Leader. State: Replica: d4f4200d3ab347c1b41864c16c72b37c, State: Running, Role: LEADER
I20260812 11:13:44.021509 27653 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } }
I20260812 11:13:44.022233 27646 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:13:44.024300 27654 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4f4200d3ab347c1b41864c16c72b37c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } } }
I20260812 11:13:44.024734 27654 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [sys.catalog]: This master's current role is: LEADER
I20260812 11:13:44.025259 27656 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4f4200d3ab347c1b41864c16c72b37c. Latest consensus state: current_term: 1 leader_uuid: "d4f4200d3ab347c1b41864c16c72b37c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } } }
I20260812 11:13:44.025689 27656 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [sys.catalog]: This master's current role is: LEADER
I20260812 11:13:44.025719 27662 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:13:44.031911 27662 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:13:44.043171 27662 catalog_manager.cc:1347] Generated new cluster ID: 4cc12389e41c429988e8e83c2136d5ea
I20260812 11:13:44.043316 27662 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:13:44.076757 27662 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:13:44.078249 27662 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:13:44.084693 27662 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c: Generated new TSK 0
I20260812 11:13:44.085871 27662 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:13:44.158375 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:43003
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:13:44.512434 27698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:44.512745 27698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:44.512869 27698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:44.520735 27698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:44.520861 27698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:44.521020 27698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:13:44.531800 27698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:43003
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:44.533229 27698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:44.534627 27698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:44.548460 27709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:44.548491 27713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:44.548575 27716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:44.549244 27698 server_base.cc:1034] running on GCE node
I20260812 11:13:44.549949 27698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:44.550998 27698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:44.552220 27698 hybrid_clock.cc:648] HybridClock initialized: now 1786533224552164 us; error 54 us; skew 500 ppm
I20260812 11:13:44.552574 27698 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:44 dist-test-slave-rmhg krb5kdc[27512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533224, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:44.555962 27698 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:13:44.557621 27698 webserver.cc:460] Webserver started at http://127.4.26.65:45073/ using document root <none> and password file <none>
I20260812 11:13:44.558379 27698 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:44.558502 27698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:44.558799 27698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:13:44.561873 27698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "e2e8fadf1c9a467994be54a4353a8a85"
format_stamp: "Formatted at 2026-08-12 11:13:44 on dist-test-slave-rmhg"
server_key: "c35558ed393a69f34f174c8548dac826"
server_key_iv: "aa4f349b057be13f8d7b5e28f0b5f8d0"
server_key_version: "encryptionkey@0"
I20260812 11:13:44.562645 27698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "e2e8fadf1c9a467994be54a4353a8a85"
format_stamp: "Formatted at 2026-08-12 11:13:44 on dist-test-slave-rmhg"
server_key: "c35558ed393a69f34f174c8548dac826"
server_key_iv: "aa4f349b057be13f8d7b5e28f0b5f8d0"
server_key_version: "encryptionkey@0"
I20260812 11:13:44.568017 27698 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:13:44.571938 27729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:44.573534 27698 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:13:44.573711 27698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "e2e8fadf1c9a467994be54a4353a8a85"
format_stamp: "Formatted at 2026-08-12 11:13:44 on dist-test-slave-rmhg"
server_key: "c35558ed393a69f34f174c8548dac826"
server_key_iv: "aa4f349b057be13f8d7b5e28f0b5f8d0"
server_key_version: "encryptionkey@0"
I20260812 11:13:44.573921 27698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:44.590968 27698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:44.595502 27698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:44.595795 27698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:44.596872 27698 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:13:44.598326 27698 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:13:44.598408 27698 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:44.598569 27698 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:13:44.598649 27698 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:44.630400 27698 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:33835
I20260812 11:13:44.630437 27943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:33835 every 8 connection(s)
I20260812 11:13:44.631763 27698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:13:44.639858 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 27698
I20260812 11:13:44.640065 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:13:44.640728 4201 external_mini_cluster.cc:1428] Setting key e97f72c7131043d9653d66af62f0e20c
Aug 12 11:13:44 dist-test-slave-rmhg krb5kdc[27512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533224, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:13:44.653309 27947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:44.634501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:51233 (local address 127.4.26.126:43003)
0812 11:13:44.634966 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:44.634971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:44.635984 (+ 1013us) server_negotiation.cc:407] Connection header received
0812 11:13:44.637866 (+ 1882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:44.637873 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:44.637954 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:44.638063 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:44.639712 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:44.640556 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:44.642792 (+ 2236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:44.643279 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:44.643405 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:44.647243 (+ 3838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:44.647248 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:44.647252 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:44.647287 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:44.650086 (+ 2799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:44.650879 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:44.650884 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:44.650886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:44.651022 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:44.651459 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:44.651463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:44.651465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:44.651745 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:44.651884 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:44.652631 (+ 747us) server_negotiation.cc:299] Negotiation successful
0812 11:13:44.652885 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":217,"threads_started":1}
I20260812 11:13:44.654297 27950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:44.634986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:51233)
0812 11:13:44.635802 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:44.635842 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:44.637580 (+ 1738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:44.638311 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:44.638320 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:44.638849 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:44.639484 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:44.639521 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:44.640742 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:44.640747 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:44.642626 (+ 1879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:44.642644 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:44.643525 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:44.643533 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:44.643799 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:44.644488 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:44.644513 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:44.646989 (+ 2476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:44.650247 (+ 3258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:44.650257 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:44.650277 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:44.650740 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:44.651132 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:44.651137 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:44.651140 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:44.651338 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:44.651873 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:44.651880 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:44.652234 (+ 354us) client_negotiation.cc:769] Sending connection context
0812 11:13:44.652500 (+ 266us) client_negotiation.cc:240] Negotiation successful
0812 11:13:44.653077 (+ 577us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":313,"threads_started":1}
I20260812 11:13:44.656003 27944 heartbeater.cc:347] Connected to a master server at 127.4.26.126:43003
I20260812 11:13:44.656365 27944 heartbeater.cc:464] Registering TS with master...
I20260812 11:13:44.657284 27944 heartbeater.cc:511] Master 127.4.26.126:43003 requested a full tablet report, sending...
I20260812 11:13:44.659956 27590 ts_manager.cc:194] Registered new tserver with Master: e2e8fadf1c9a467994be54a4353a8a85 (127.4.26.65:33835)
I20260812 11:13:44.661921 27590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:51233
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:13:44.704453 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:43003
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:13:45.055343 27955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:45.055653 27955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:45.055786 27955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:45.063072 27955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:45.063220 27955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:45.063380 27955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:13:45.073300 27955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:43003
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:45.074681 27955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:45.076087 27955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:45.090268 27963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:45.090219 27962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:45.090292 27968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:45.091161 27955 server_base.cc:1034] running on GCE node
I20260812 11:13:45.091900 27955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:45.092955 27955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:45.094187 27955 hybrid_clock.cc:648] HybridClock initialized: now 1786533225094124 us; error 53 us; skew 500 ppm
I20260812 11:13:45.094565 27955 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:45 dist-test-slave-rmhg krb5kdc[27512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533225, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:45.098012 27955 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:13:45.099586 27955 webserver.cc:460] Webserver started at http://127.4.26.66:44573/ using document root <none> and password file <none>
I20260812 11:13:45.100314 27955 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:45.100440 27955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:45.100765 27955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:13:45.104014 27955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "4003f6472dc047dd99392acebf43aac4"
format_stamp: "Formatted at 2026-08-12 11:13:45 on dist-test-slave-rmhg"
server_key: "b87f931872269c7db14c393913240371"
server_key_iv: "6ebf9446b2e7ea6e65c32a443f1daa8f"
server_key_version: "encryptionkey@0"
I20260812 11:13:45.104894 27955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "4003f6472dc047dd99392acebf43aac4"
format_stamp: "Formatted at 2026-08-12 11:13:45 on dist-test-slave-rmhg"
server_key: "b87f931872269c7db14c393913240371"
server_key_iv: "6ebf9446b2e7ea6e65c32a443f1daa8f"
server_key_version: "encryptionkey@0"
I20260812 11:13:45.110795 27955 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 11:13:45.115002 27981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:45.116604 27955 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:13:45.116796 27955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "4003f6472dc047dd99392acebf43aac4"
format_stamp: "Formatted at 2026-08-12 11:13:45 on dist-test-slave-rmhg"
server_key: "b87f931872269c7db14c393913240371"
server_key_iv: "6ebf9446b2e7ea6e65c32a443f1daa8f"
server_key_version: "encryptionkey@0"
I20260812 11:13:45.117035 27955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:45.135356 27955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:45.139900 27955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:45.140201 27955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:45.141304 27955 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:13:45.142976 27955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:13:45.143093 27955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:45.143244 27955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:13:45.143308 27955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:45.177053 27955 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:40569
I20260812 11:13:45.177095 28200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:40569 every 8 connection(s)
I20260812 11:13:45.178762 27955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:13:45.184006 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 27955
I20260812 11:13:45.184221 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:13:45.184731 4201 external_mini_cluster.cc:1428] Setting key 9255b932580cb6579b661313390e295b
Aug 12 11:13:45 dist-test-slave-rmhg krb5kdc[27512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533225, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:13:45.201664 28205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:45.181543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:50717 (local address 127.4.26.126:43003)
0812 11:13:45.181999 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:45.182003 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:45.183103 (+ 1100us) server_negotiation.cc:407] Connection header received
0812 11:13:45.185097 (+ 1994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:45.185104 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:45.185218 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:45.185322 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:45.187403 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.188200 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.190657 (+ 2457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.191141 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.191252 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:45.195515 (+ 4263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:45.195521 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:45.195524 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:45.195599 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:45.198220 (+ 2621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:45.199032 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:45.199037 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:45.199039 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:45.199180 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:45.199663 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:45.199668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:45.199670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:45.199993 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:45.200177 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:45.200967 (+ 790us) server_negotiation.cc:299] Negotiation successful
0812 11:13:45.201258 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":225,"threads_started":1}
I20260812 11:13:45.202708 28206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:45.182130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:50717)
0812 11:13:45.182921 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:45.182962 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:45.184773 (+ 1811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:45.185617 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:45.185625 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:45.186356 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:45.187163 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:45.187202 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.188390 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.188396 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:45.190413 (+ 2017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:45.190444 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.191397 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.191404 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:45.191743 (+ 339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:45.192519 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:45.192548 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:45.195238 (+ 2690us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:45.198402 (+ 3164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:45.198413 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:45.198430 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:45.198896 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:45.199294 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:45.199299 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:45.199303 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:45.199529 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:45.200179 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:45.200188 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:45.200566 (+ 378us) client_negotiation.cc:769] Sending connection context
0812 11:13:45.200837 (+ 271us) client_negotiation.cc:240] Negotiation successful
0812 11:13:45.201468 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":305,"threads_started":1}
I20260812 11:13:45.204485 28201 heartbeater.cc:347] Connected to a master server at 127.4.26.126:43003
I20260812 11:13:45.204799 28201 heartbeater.cc:464] Registering TS with master...
I20260812 11:13:45.205628 28201 heartbeater.cc:511] Master 127.4.26.126:43003 requested a full tablet report, sending...
I20260812 11:13:45.207206 27590 ts_manager.cc:194] Registered new tserver with Master: 4003f6472dc047dd99392acebf43aac4 (127.4.26.66:40569)
I20260812 11:13:45.208065 27590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:50717
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:13:45.250487 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:43003
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:13:45.597873 28211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:45.598204 28211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:45.598351 28211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:45.605892 28211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:45.606038 28211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:45.606196 28211 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:13:45.616422 28211 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:43003
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:45.617863 28211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:45.619257 28211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:45.633035 28219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:45.633188 28218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:45.633569 28221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:45.637872 28211 server_base.cc:1034] running on GCE node
I20260812 11:13:45.638561 28211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:45.639631 28211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:45.640839 28211 hybrid_clock.cc:648] HybridClock initialized: now 1786533225640789 us; error 44 us; skew 500 ppm
I20260812 11:13:45.641202 28211 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:45 dist-test-slave-rmhg krb5kdc[27512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533225, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:45.644812 28211 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:13:45.646639 28211 webserver.cc:460] Webserver started at http://127.4.26.67:43567/ using document root <none> and password file <none>
I20260812 11:13:45.647430 28211 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:45.647573 28211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:45.647886 28211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:13:45.651023 28211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "bb7141dc9ea44360847e2fb0114db788"
format_stamp: "Formatted at 2026-08-12 11:13:45 on dist-test-slave-rmhg"
server_key: "7c7f62cfc024151727fa8c1021a2be65"
server_key_iv: "ba876337029024e97e353561d7516648"
server_key_version: "encryptionkey@0"
I20260812 11:13:45.651840 28211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "bb7141dc9ea44360847e2fb0114db788"
format_stamp: "Formatted at 2026-08-12 11:13:45 on dist-test-slave-rmhg"
server_key: "7c7f62cfc024151727fa8c1021a2be65"
server_key_iv: "ba876337029024e97e353561d7516648"
server_key_version: "encryptionkey@0"
I20260812 11:13:45.657591 28211 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260812 11:13:45.661543 28234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:45.663064 28211 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:13:45.663245 28211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "bb7141dc9ea44360847e2fb0114db788"
format_stamp: "Formatted at 2026-08-12 11:13:45 on dist-test-slave-rmhg"
server_key: "7c7f62cfc024151727fa8c1021a2be65"
server_key_iv: "ba876337029024e97e353561d7516648"
server_key_version: "encryptionkey@0"
I20260812 11:13:45.663446 28211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:45.665761 27944 heartbeater.cc:503] Master 127.4.26.126:43003 was elected leader, sending a full tablet report...
I20260812 11:13:45.684214 28211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:45.689059 28211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:45.689400 28211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:45.690467 28211 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:13:45.691941 28211 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:13:45.692026 28211 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:45.692154 28211 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:13:45.692209 28211 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:45.724769 28211 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:44783
I20260812 11:13:45.724833 28424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:44783 every 8 connection(s)
I20260812 11:13:45.726179 28211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:13:45.730090 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 28211
I20260812 11:13:45.730271 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:13:45.730809 4201 external_mini_cluster.cc:1428] Setting key 565548e5ea0e3f3d0dd0a63a0b88944f
Aug 12 11:13:45 dist-test-slave-rmhg krb5kdc[27512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533225, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:13:45.748373 28428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:45.728920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:43639 (local address 127.4.26.126:43003)
0812 11:13:45.729462 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:45.729468 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:45.730541 (+ 1073us) server_negotiation.cc:407] Connection header received
0812 11:13:45.732750 (+ 2209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:45.732755 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:45.732845 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:45.732966 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:45.734883 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.735689 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.737548 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.737944 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.738042 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:45.741648 (+ 3606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:45.741653 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:45.741657 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:45.741707 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:45.744646 (+ 2939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:45.745700 (+ 1054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:45.745706 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:45.745709 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:45.745883 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:45.746420 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:45.746426 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:45.746429 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:45.746845 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:45.747023 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:45.747855 (+ 832us) server_negotiation.cc:299] Negotiation successful
0812 11:13:45.748083 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":282,"threads_started":1}
I20260812 11:13:45.749384 28430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:45.729506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:43639)
0812 11:13:45.730347 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:45.730408 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:45.732462 (+ 2054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:45.733248 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:45.733261 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:45.734092 (+ 831us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:45.734698 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:45.734717 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.735845 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.735849 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:45.737368 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:45.737382 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.738152 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.738157 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:45.738372 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:45.739073 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:45.739097 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:45.741386 (+ 2289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:45.744824 (+ 3438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:45.744835 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:45.744851 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:45.745516 (+ 665us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:45.746014 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:45.746018 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:45.746021 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:45.746284 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:45.746991 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:45.746999 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:45.747455 (+ 456us) client_negotiation.cc:769] Sending connection context
0812 11:13:45.747709 (+ 254us) client_negotiation.cc:240] Negotiation successful
0812 11:13:45.748165 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":341,"threads_started":1}
I20260812 11:13:45.750861 28425 heartbeater.cc:347] Connected to a master server at 127.4.26.126:43003
I20260812 11:13:45.751171 28425 heartbeater.cc:464] Registering TS with master...
I20260812 11:13:45.751981 28425 heartbeater.cc:511] Master 127.4.26.126:43003 requested a full tablet report, sending...
I20260812 11:13:45.753577 27590 ts_manager.cc:194] Registered new tserver with Master: bb7141dc9ea44360847e2fb0114db788 (127.4.26.67:44783)
I20260812 11:13:45.754436 27590 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:43639
I20260812 11:13:45.759730 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:13:45.779227 28428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:45.764778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45934 (local address 127.4.26.126:43003)
0812 11:13:45.765028 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:45.765036 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:45.765360 (+ 324us) server_negotiation.cc:407] Connection header received
0812 11:13:45.765515 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:45.765519 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:45.765598 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:45.765687 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:45.767274 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.768251 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.769824 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.770268 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.770375 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:45.773127 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:45.773133 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:45.773136 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:45.773195 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:45.776035 (+ 2840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:45.776892 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:45.776897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:45.776900 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:45.777049 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:45.777545 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:45.777550 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:45.777552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:45.778077 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:45.778292 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:45.778655 (+ 363us) server_negotiation.cc:299] Negotiation successful
0812 11:13:45.778888 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 11:13:45.784016 27590 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45934:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:13:45.791426 27590 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:13:45.831481 28450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:45.805313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34196 (local address 127.4.26.66:40569)
0812 11:13:45.820097 (+ 14784us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:45.820106 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:45.820142 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:13:45.820869 (+ 727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:45.820878 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:45.821195 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:45.821432 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:13:45.822765 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.824555 (+ 1790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.828132 (+ 3577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.829721 (+ 1589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.829827 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:45.830044 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:45.830942 (+ 898us) server_negotiation.cc:299] Negotiation successful
0812 11:13:45.831134 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14635,"thread_start_us":14477,"threads_started":1}
I20260812 11:13:45.831490 28452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:45.805821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46982 (local address 127.4.26.67:44783)
0812 11:13:45.819275 (+ 13454us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:45.819288 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:45.820913 (+ 1625us) server_negotiation.cc:407] Connection header received
0812 11:13:45.821343 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:45.821352 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:45.821594 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:45.821829 (+ 235us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:13:45.822978 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.824656 (+ 1678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.828164 (+ 3508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.829696 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.829835 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:45.830117 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:45.830917 (+ 800us) server_negotiation.cc:299] Negotiation successful
0812 11:13:45.831115 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13062,"thread_start_us":13498,"threads_started":1}
I20260812 11:13:45.831547 28454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:45.805210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:44783 (local address 127.0.0.1:46982)
0812 11:13:45.820724 (+ 15514us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:45.820744 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:45.821059 (+ 315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:45.822181 (+ 1122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:45.822185 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:45.822210 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:13:45.822741 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:45.822757 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.824795 (+ 2038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.824799 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:45.827902 (+ 3103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:45.827920 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.830388 (+ 2468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.830398 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:45.830654 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:45.830717 (+ 63us) client_negotiation.cc:769] Sending connection context
0812 11:13:45.830840 (+ 123us) client_negotiation.cc:240] Negotiation successful
0812 11:13:45.831125 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15316,"mutex_wait_us":199,"thread_start_us":17598,"threads_started":1}
I20260812 11:13:45.831743 28459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:45.808941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49508 (local address 127.4.26.65:33835)
0812 11:13:45.820689 (+ 11748us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:45.820697 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:45.823208 (+ 2511us) server_negotiation.cc:407] Connection header received
0812 11:13:45.823352 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:45.823358 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:45.823531 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:45.823697 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:13:45.824313 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.825666 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.828132 (+ 2466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.830046 (+ 1914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.830198 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:45.830413 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:45.831246 (+ 833us) server_negotiation.cc:299] Negotiation successful
0812 11:13:45.831422 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11583,"thread_start_us":11400,"threads_started":1}
I20260812 11:13:45.832219 28448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:45.808211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33835 (local address 127.0.0.1:49508)
0812 11:13:45.823070 (+ 14859us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:45.823088 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:45.823220 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:45.823746 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:45.823751 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:45.823775 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:13:45.824149 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:45.824159 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.825847 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.825852 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:45.827904 (+ 2052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:45.827918 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.830335 (+ 2417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.830342 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:45.830623 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:45.830716 (+ 93us) client_negotiation.cc:769] Sending connection context
0812 11:13:45.830844 (+ 128us) client_negotiation.cc:240] Negotiation successful
0812 11:13:45.831128 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14735,"mutex_wait_us":92,"thread_start_us":12352,"threads_started":1}
I20260812 11:13:45.833045 28449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:45.805107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:40569 (local address 127.0.0.1:34196)
0812 11:13:45.819839 (+ 14732us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:45.819899 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:45.820155 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:45.821774 (+ 1619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:45.821782 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:45.821816 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:13:45.822339 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:45.822516 (+ 177us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.824747 (+ 2231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.824753 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:45.827902 (+ 3149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:45.827920 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.830305 (+ 2385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.830312 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:45.830610 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:45.830716 (+ 106us) client_negotiation.cc:769] Sending connection context
0812 11:13:45.832651 (+ 1935us) client_negotiation.cc:240] Negotiation successful
0812 11:13:45.832778 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14403,"mutex_wait_us":172,"thread_start_us":15400,"threads_started":1}
I20260812 11:13:45.836382 27806 tablet_service.cc:1467] Processing CreateTablet for tablet e1c6eb01525e42ac9577f9614a4c83b7 (DEFAULT_TABLE table=test-table [id=b4556d82992645fd8416c3375b2754d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:13:45.836382 28319 tablet_service.cc:1467] Processing CreateTablet for tablet e1c6eb01525e42ac9577f9614a4c83b7 (DEFAULT_TABLE table=test-table [id=b4556d82992645fd8416c3375b2754d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:13:45.838145 28319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1c6eb01525e42ac9577f9614a4c83b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:13:45.838155 27806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1c6eb01525e42ac9577f9614a4c83b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:13:45.841188 28066 tablet_service.cc:1467] Processing CreateTablet for tablet e1c6eb01525e42ac9577f9614a4c83b7 (DEFAULT_TABLE table=test-table [id=b4556d82992645fd8416c3375b2754d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:13:45.842517 28066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1c6eb01525e42ac9577f9614a4c83b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:13:45.854527 28461 tablet_bootstrap.cc:492] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85: Bootstrap starting.
I20260812 11:13:45.855579 28460 tablet_bootstrap.cc:492] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788: Bootstrap starting.
I20260812 11:13:45.857941 28462 tablet_bootstrap.cc:492] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4: Bootstrap starting.
I20260812 11:13:45.859627 28461 tablet_bootstrap.cc:654] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85: Neither blocks nor log segments found. Creating new log.
I20260812 11:13:45.859800 28460 tablet_bootstrap.cc:654] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788: Neither blocks nor log segments found. Creating new log.
I20260812 11:13:45.860836 28460 log.cc:824] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:45.860978 28461 log.cc:824] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:45.861830 28462 tablet_bootstrap.cc:654] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4: Neither blocks nor log segments found. Creating new log.
I20260812 11:13:45.863395 28462 log.cc:824] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:45.865043 28461 tablet_bootstrap.cc:492] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85: No bootstrap required, opened a new log
I20260812 11:13:45.865042 28460 tablet_bootstrap.cc:492] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788: No bootstrap required, opened a new log
I20260812 11:13:45.865391 28460 ts_tablet_manager.cc:1397] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260812 11:13:45.865391 28461 ts_tablet_manager.cc:1397] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260812 11:13:45.866217 28462 tablet_bootstrap.cc:492] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4: No bootstrap required, opened a new log
I20260812 11:13:45.866494 28462 ts_tablet_manager.cc:1397] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260812 11:13:45.874454 28462 raft_consensus.cc:348] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } } peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } }
I20260812 11:13:45.874904 28462 raft_consensus.cc:374] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:13:45.875047 28462 raft_consensus.cc:729] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4003f6472dc047dd99392acebf43aac4, State: Initialized, Role: FOLLOWER
I20260812 11:13:45.875703 28462 consensus_queue.cc:260] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } } peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } }
I20260812 11:13:45.876955 28201 heartbeater.cc:503] Master 127.4.26.126:43003 was elected leader, sending a full tablet report...
I20260812 11:13:45.877558 28462 ts_tablet_manager.cc:1428] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4: Time spent starting tablet: real 0.011s user 0.006s sys 0.006s
I20260812 11:13:45.877458 28461 raft_consensus.cc:348] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } } peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } }
I20260812 11:13:45.877919 28461 raft_consensus.cc:374] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:13:45.878011 28461 raft_consensus.cc:729] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2e8fadf1c9a467994be54a4353a8a85, State: Initialized, Role: FOLLOWER
I20260812 11:13:45.876549 28460 raft_consensus.cc:348] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } } peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } }
I20260812 11:13:45.878904 28460 raft_consensus.cc:374] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:13:45.879027 28460 raft_consensus.cc:729] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb7141dc9ea44360847e2fb0114db788, State: Initialized, Role: FOLLOWER
I20260812 11:13:45.879666 28460 consensus_queue.cc:260] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } } peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } }
I20260812 11:13:45.880903 28425 heartbeater.cc:503] Master 127.4.26.126:43003 was elected leader, sending a full tablet report...
I20260812 11:13:45.878701 28461 consensus_queue.cc:260] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } } peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } }
I20260812 11:13:45.881783 28460 ts_tablet_manager.cc:1428] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788: Time spent starting tablet: real 0.016s user 0.012s sys 0.002s
I20260812 11:13:45.890257 28461 ts_tablet_manager.cc:1428] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85: Time spent starting tablet: real 0.025s user 0.015s sys 0.004s
W20260812 11:13:45.930891 28203 tablet.cc:2369] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:13:45.944094 28475 raft_consensus.cc:482] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:13:45.944424 28475 raft_consensus.cc:504] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } } peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } }
I20260812 11:13:45.946347 28475 leader_election.cc:288] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4003f6472dc047dd99392acebf43aac4 (127.4.26.66:40569), bb7141dc9ea44360847e2fb0114db788 (127.4.26.67:44783)
I20260812 11:13:45.953962 28450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:45.947528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:52829 (local address 127.4.26.66:40569)
0812 11:13:45.947739 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:45.947746 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:45.948353 (+ 607us) server_negotiation.cc:407] Connection header received
0812 11:13:45.948532 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:45.948536 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:45.948601 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:45.948676 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:13:45.949404 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.950135 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.952168 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.952960 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.953088 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:45.953218 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:45.953580 (+ 362us) server_negotiation.cc:299] Negotiation successful
0812 11:13:45.953711 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:13:45.953980 28452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:45.947053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:38641 (local address 127.4.26.67:44783)
0812 11:13:45.947270 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:45.947277 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:45.948394 (+ 1117us) server_negotiation.cc:407] Connection header received
0812 11:13:45.948553 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:45.948563 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:45.948627 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:45.948704 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:13:45.949467 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.950232 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.952182 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.952980 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.953098 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:45.953231 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:45.953607 (+ 376us) server_negotiation.cc:299] Negotiation successful
0812 11:13:45.953742 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:13:45.954206 28478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:45.946865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:44783 (local address 127.4.26.65:38641)
0812 11:13:45.948268 (+ 1403us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:45.948287 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:45.948418 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:45.948734 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:45.948739 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:45.948762 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:13:45.949304 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:45.949316 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.950378 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.950382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:45.952004 (+ 1622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:45.952018 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.953281 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.953286 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:45.953450 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:45.953474 (+ 24us) client_negotiation.cc:769] Sending connection context
0812 11:13:45.953555 (+ 81us) client_negotiation.cc:240] Negotiation successful
0812 11:13:45.953682 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1302,"mutex_wait_us":36,"thread_start_us":971,"threads_started":1}
I20260812 11:13:45.954253 28480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:45.946684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:40569 (local address 127.4.26.65:52829)
0812 11:13:45.948229 (+ 1545us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:45.948246 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:45.948390 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:45.948707 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:45.948711 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:45.948735 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:13:45.949261 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:45.949276 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.950271 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.950276 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:45.952007 (+ 1731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:45.952020 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.953233 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.953242 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:45.953415 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:45.953451 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:13:45.953536 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 11:13:45.953670 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1408,"mutex_wait_us":107,"thread_start_us":1275,"threads_started":1}
I20260812 11:13:45.955607 28346 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1c6eb01525e42ac9577f9614a4c83b7" candidate_uuid: "e2e8fadf1c9a467994be54a4353a8a85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7141dc9ea44360847e2fb0114db788" is_pre_election: true
I20260812 11:13:45.955653 28102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1c6eb01525e42ac9577f9614a4c83b7" candidate_uuid: "e2e8fadf1c9a467994be54a4353a8a85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4003f6472dc047dd99392acebf43aac4" is_pre_election: true
I20260812 11:13:45.956123 28346 raft_consensus.cc:2454] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2e8fadf1c9a467994be54a4353a8a85 in term 0.
I20260812 11:13:45.956121 28102 raft_consensus.cc:2454] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2e8fadf1c9a467994be54a4353a8a85 in term 0.
I20260812 11:13:45.956770 27737 leader_election.cc:302] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb7141dc9ea44360847e2fb0114db788, e2e8fadf1c9a467994be54a4353a8a85; no voters:
I20260812 11:13:45.957177 28475 raft_consensus.cc:2781] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:13:45.957329 28475 raft_consensus.cc:482] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:13:45.957429 28475 raft_consensus.cc:3037] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:13:45.959718 28475 raft_consensus.cc:504] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } } peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } }
I20260812 11:13:45.960415 28475 leader_election.cc:288] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [CANDIDATE]: Term 1 election: Requested vote from peers 4003f6472dc047dd99392acebf43aac4 (127.4.26.66:40569), bb7141dc9ea44360847e2fb0114db788 (127.4.26.67:44783)
I20260812 11:13:45.960961 28102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1c6eb01525e42ac9577f9614a4c83b7" candidate_uuid: "e2e8fadf1c9a467994be54a4353a8a85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4003f6472dc047dd99392acebf43aac4"
I20260812 11:13:45.961052 28346 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1c6eb01525e42ac9577f9614a4c83b7" candidate_uuid: "e2e8fadf1c9a467994be54a4353a8a85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7141dc9ea44360847e2fb0114db788"
I20260812 11:13:45.961206 28102 raft_consensus.cc:3037] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:13:45.961303 28346 raft_consensus.cc:3037] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:13:45.963784 28102 raft_consensus.cc:2454] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2e8fadf1c9a467994be54a4353a8a85 in term 1.
I20260812 11:13:45.964332 27736 leader_election.cc:302] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4003f6472dc047dd99392acebf43aac4, e2e8fadf1c9a467994be54a4353a8a85; no voters:
I20260812 11:13:45.964455 28346 raft_consensus.cc:2454] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2e8fadf1c9a467994be54a4353a8a85 in term 1.
I20260812 11:13:45.964761 28475 raft_consensus.cc:2781] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:13:45.965313 28475 raft_consensus.cc:686] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [term 1 LEADER]: Becoming Leader. State: Replica: e2e8fadf1c9a467994be54a4353a8a85, State: Running, Role: LEADER
I20260812 11:13:45.965876 28475 consensus_queue.cc:237] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } } peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } }
I20260812 11:13:45.970830 27589 catalog_manager.cc:5495] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2e8fadf1c9a467994be54a4353a8a85 (127.4.26.65). New cstate: current_term: 1 leader_uuid: "e2e8fadf1c9a467994be54a4353a8a85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } health_report { overall_health: HEALTHY } } }
W20260812 11:13:45.977946 28427 tablet.cc:2369] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:13:45.991019 28459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:45.985347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49524 (local address 127.4.26.65:33835)
0812 11:13:45.985575 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:45.985579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:45.985595 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:13:45.985697 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:45.985700 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:45.985797 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:45.985943 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:13:45.986398 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.987140 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.988626 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:45.989074 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:45.989230 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:45.989828 (+ 598us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:13:45.990383 (+ 555us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:13:45.990530 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:45.990663 (+ 133us) server_negotiation.cc:299] Negotiation successful
0812 11:13:45.990759 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:13:45.999768 28346 raft_consensus.cc:1261] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788 [term 1 FOLLOWER]: Refusing update from remote peer e2e8fadf1c9a467994be54a4353a8a85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:13:45.999768 28102 raft_consensus.cc:1261] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4 [term 1 FOLLOWER]: Refusing update from remote peer e2e8fadf1c9a467994be54a4353a8a85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:13:46.000898 28481 consensus_queue.cc:1035] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:13:46.001302 28475 consensus_queue.cc:1035] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:13:46.014528 28487 mvcc.cc:205] Tried to move back new op lower bound from 7317640093684314112 to 7317640093560262656. Current Snapshot: MvccSnapshot[applied={T|T < 7317640093684314112}]
I20260812 11:13:46.028998 27589 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:13:46.029340 27589 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45934:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:13:46.033195 27589 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c: Sending DeleteTablet for 3 replicas of tablet e1c6eb01525e42ac9577f9614a4c83b7
I20260812 11:13:46.034534 28066 tablet_service.cc:1514] Processing DeleteTablet for tablet e1c6eb01525e42ac9577f9614a4c83b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:13:46 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:34196
I20260812 11:13:46.034577 28319 tablet_service.cc:1514] Processing DeleteTablet for tablet e1c6eb01525e42ac9577f9614a4c83b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:13:46 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:46982
I20260812 11:13:46.035398 27806 tablet_service.cc:1514] Processing DeleteTablet for tablet e1c6eb01525e42ac9577f9614a4c83b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:13:46 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:49508
I20260812 11:13:46.036334 28506 tablet_replica.cc:330] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85: stopping tablet replica
I20260812 11:13:46.036892 28506 raft_consensus.cc:2229] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:13:46.037794 28506 raft_consensus.cc:2258] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:13:46.038349 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 27698
I20260812 11:13:46.040264 28506 ts_tablet_manager.cc:1905] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:13:46.049773 28506 ts_tablet_manager.cc:1918] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:13:46.050227 28506 log.cc:1196] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/e1c6eb01525e42ac9577f9614a4c83b7
I20260812 11:13:46.051014 28506 ts_tablet_manager.cc:1939] T e1c6eb01525e42ac9577f9614a4c83b7 P e2e8fadf1c9a467994be54a4353a8a85: Deleting consensus metadata
I20260812 11:13:46.053601 27563 catalog_manager.cc:4841] TS e2e8fadf1c9a467994be54a4353a8a85 (127.4.26.65:33835): tablet e1c6eb01525e42ac9577f9614a4c83b7 (table test-table [id=b4556d82992645fd8416c3375b2754d0]) successfully deleted
I20260812 11:13:46.058787 28505 tablet_replica.cc:330] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788: stopping tablet replica
I20260812 11:13:46.059042 28504 tablet_replica.cc:330] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4: stopping tablet replica
I20260812 11:13:46.059528 28505 raft_consensus.cc:2229] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:13:46.059535 28504 raft_consensus.cc:2229] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:13:46.060146 28504 raft_consensus.cc:2258] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:13:46.060158 28505 raft_consensus.cc:2258] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:13:46.062783 28504 ts_tablet_manager.cc:1905] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:13:46.063472 28505 ts_tablet_manager.cc:1905] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:13:46.071004 28504 ts_tablet_manager.cc:1918] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:13:46.071012 28505 ts_tablet_manager.cc:1918] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:13:46.071233 28504 log.cc:1196] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/e1c6eb01525e42ac9577f9614a4c83b7
I20260812 11:13:46.071429 28505 log.cc:1196] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/e1c6eb01525e42ac9577f9614a4c83b7
I20260812 11:13:46.071869 28504 ts_tablet_manager.cc:1939] T e1c6eb01525e42ac9577f9614a4c83b7 P 4003f6472dc047dd99392acebf43aac4: Deleting consensus metadata
I20260812 11:13:46.072134 28505 ts_tablet_manager.cc:1939] T e1c6eb01525e42ac9577f9614a4c83b7 P bb7141dc9ea44360847e2fb0114db788: Deleting consensus metadata
Aug 12 11:13:46 dist-test-slave-rmhg krb5kdc[27512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:13:46.074079 27568 catalog_manager.cc:4841] TS bb7141dc9ea44360847e2fb0114db788 (127.4.26.67:44783): tablet e1c6eb01525e42ac9577f9614a4c83b7 (table test-table [id=b4556d82992645fd8416c3375b2754d0]) successfully deleted
I20260812 11:13:46.074105 27566 catalog_manager.cc:4841] TS 4003f6472dc047dd99392acebf43aac4 (127.4.26.66:40569): tablet e1c6eb01525e42ac9577f9614a4c83b7 (table test-table [id=b4556d82992645fd8416c3375b2754d0]) successfully deleted
I20260812 11:13:46.083050 28459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:46.039589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49540 (local address 127.4.26.65:33835)
0812 11:13:46.039765 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:46.039772 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:46.057969 (+ 18197us) server_negotiation.cc:407] Connection header received
0812 11:13:46.058207 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:46.058213 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:46.058315 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:46.058464 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:46.060731 (+ 2267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:46.061999 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:46.064508 (+ 2509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:46.065295 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:46.065431 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:46.075641 (+ 10210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:46.075658 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:46.075675 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:46.075725 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:46.079420 (+ 3695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:46.080562 (+ 1142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:46.080572 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:46.080574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:46.080766 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:46.081287 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:46.081292 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:46.081294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:46.081776 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:46.082052 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:46.082451 (+ 399us) server_negotiation.cc:299] Negotiation successful
0812 11:13:46.082706 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:13:46.083786 27932 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:46.198202 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 27698
I20260812 11:13:46.222329 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 27955
Aug 12 11:13:46 dist-test-slave-rmhg krb5kdc[27512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:13:46.243551 28450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:46.223177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34212 (local address 127.4.26.66:40569)
0812 11:13:46.223374 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:46.223380 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:46.223449 (+ 69us) server_negotiation.cc:407] Connection header received
0812 11:13:46.223657 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:46.223663 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:46.223750 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:46.223840 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:46.225282 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:46.226053 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:46.227517 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:46.227933 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:46.228060 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:46.237294 (+ 9234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:46.237313 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:46.237333 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:46.237385 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:46.240393 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:46.241244 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:46.241254 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:46.241256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:46.241403 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:46.241847 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:46.241851 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:46.241853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:46.242302 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:46.242601 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:46.242974 (+ 373us) server_negotiation.cc:299] Negotiation successful
0812 11:13:46.243219 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 11:13:46.244272 28196 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:46.336696 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 27955
I20260812 11:13:46.358346 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 28211
Aug 12 11:13:46 dist-test-slave-rmhg krb5kdc[27512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533223, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:13:46.375003 28452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:46.359256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46984 (local address 127.4.26.67:44783)
0812 11:13:46.359424 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:46.359429 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:46.359453 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:13:46.359670 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:46.359675 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:46.359752 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:46.359854 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:46.361308 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:46.362167 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:46.363729 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:46.364161 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:46.364275 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:46.369001 (+ 4726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:46.369028 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:46.369054 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:46.369109 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:46.372155 (+ 3046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:46.372934 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:46.372943 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:46.372945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:46.373115 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:46.373563 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:46.373567 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:46.373569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:46.374008 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:46.374243 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:46.374509 (+ 266us) server_negotiation.cc:299] Negotiation successful
0812 11:13:46.374739 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:13:46.375906 28418 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:46.471376 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 28211
I20260812 11:13:46.493162 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 27536
I20260812 11:13:46.494362 27635 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:46.605448 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 27536
I20260812 11:13:46.632827 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:43003
--webserver_interface=127.4.26.126
--webserver_port=44341
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:43003
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:13:46.986025 28518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:46.986390 28518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:46.986528 28518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:46.994182 28518 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:13:46.994335 28518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:46.994417 28518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:46.994494 28518 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:13:46.994565 28518 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:13:47.005199 28518 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:43003
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:43003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=44341
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:47.006688 28518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:47.008145 28518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:47.034689 28532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:47.034689 28537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:47.034644 28533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:47.035115 28518 server_base.cc:1034] running on GCE node
I20260812 11:13:47.036366 28518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:47.038321 28518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:47.039588 28518 hybrid_clock.cc:648] HybridClock initialized: now 1786533227039495 us; error 71 us; skew 500 ppm
I20260812 11:13:47.040135 28518 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:47 dist-test-slave-rmhg krb5kdc[27512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533227, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:47.049726 28518 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:13:47.051798 28518 webserver.cc:460] Webserver started at http://127.4.26.126:44341/ using document root <none> and password file <none>
I20260812 11:13:47.052656 28518 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:47.052817 28518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:47.059381 28518 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260812 11:13:47.062872 28555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:47.064554 28518 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:13:47.064747 28518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "d4f4200d3ab347c1b41864c16c72b37c"
format_stamp: "Formatted at 2026-08-12 11:13:43 on dist-test-slave-rmhg"
server_key: "62e46ba06fecdb11ade5faaaaa7d8c86"
server_key_iv: "77b389e1bf4a86f2d3c5b10a72d4113a"
server_key_version: "encryptionkey@0"
I20260812 11:13:47.065936 28518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:47.083882 28518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:47.088801 28518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:47.089128 28518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:47.109038 28518 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:43003
I20260812 11:13:47.109083 28638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:43003 every 8 connection(s)
I20260812 11:13:47.110746 28518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:13:47.112771 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 28518
I20260812 11:13:47.113620 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:33835
--local_ip_for_outbound_sockets=127.4.26.65
--tserver_master_addrs=127.4.26.126:43003
--webserver_port=45073
--webserver_interface=127.4.26.65
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:13:47.118471 28639 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:13:47.122020 28639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c: Bootstrap starting.
I20260812 11:13:47.142356 28639 log.cc:824] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:47.155715 28639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:13:47.156284 28639 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c: Bootstrap complete.
I20260812 11:13:47.166725 28639 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } }
I20260812 11:13:47.167723 28639 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4f4200d3ab347c1b41864c16c72b37c, State: Initialized, Role: FOLLOWER
I20260812 11:13:47.168478 28639 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } }
I20260812 11:13:47.168756 28639 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:13:47.168885 28639 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:13:47.169061 28639 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:13:47.173871 28639 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } }
I20260812 11:13:47.174475 28639 leader_election.cc:302] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4f4200d3ab347c1b41864c16c72b37c; no voters:
I20260812 11:13:47.175145 28639 leader_election.cc:288] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 11:13:47.175312 28646 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:13:47.176401 28646 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 2 LEADER]: Becoming Leader. State: Replica: d4f4200d3ab347c1b41864c16c72b37c, State: Running, Role: LEADER
I20260812 11:13:47.177043 28646 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } }
I20260812 11:13:47.177676 28639 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:13:47.179736 28649 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4f4200d3ab347c1b41864c16c72b37c. Latest consensus state: current_term: 2 leader_uuid: "d4f4200d3ab347c1b41864c16c72b37c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } } }
I20260812 11:13:47.180267 28649 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [sys.catalog]: This master's current role is: LEADER
I20260812 11:13:47.180814 28647 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d4f4200d3ab347c1b41864c16c72b37c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } } }
I20260812 11:13:47.181391 28647 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [sys.catalog]: This master's current role is: LEADER
I20260812 11:13:47.192476 28655 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:13:47.201683 28655 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:13:47.203284 28655 catalog_manager.cc:1259] Loaded cluster ID: 4cc12389e41c429988e8e83c2136d5ea
I20260812 11:13:47.203413 28655 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:13:47.207355 28655 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260812 11:13:47.224880 28655 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260812 11:13:47.235226 28655 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:13:47.237141 28655 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c: Loaded TSK: 0
I20260812 11:13:47.238986 28655 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:13:47.485226 28644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:47.485548 28644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:47.485683 28644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:47.493265 28644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:47.493388 28644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:47.493534 28644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:13:47.503774 28644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:33835
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=45073
--tserver_master_addrs=127.4.26.126:43003
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:47.505232 28644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:47.506615 28644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:47.522339 28680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:47.522236 28686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:47.522938 28691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:47.523582 28644 server_base.cc:1034] running on GCE node
I20260812 11:13:47.524402 28644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:47.525724 28644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:47.526968 28644 hybrid_clock.cc:648] HybridClock initialized: now 1786533227526895 us; error 61 us; skew 500 ppm
I20260812 11:13:47.527360 28644 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:47 dist-test-slave-rmhg krb5kdc[27512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533227, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:47.531369 28644 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:13:47.533016 28644 webserver.cc:460] Webserver started at http://127.4.26.65:45073/ using document root <none> and password file <none>
I20260812 11:13:47.533775 28644 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:47.533907 28644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:47.539937 28644 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260812 11:13:47.543511 28707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:47.545451 28644 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:13:47.545662 28644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "e2e8fadf1c9a467994be54a4353a8a85"
format_stamp: "Formatted at 2026-08-12 11:13:44 on dist-test-slave-rmhg"
server_key: "c35558ed393a69f34f174c8548dac826"
server_key_iv: "aa4f349b057be13f8d7b5e28f0b5f8d0"
server_key_version: "encryptionkey@0"
I20260812 11:13:47.546764 28644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:47.561944 28644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:47.566792 28644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:47.567081 28644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:47.568128 28644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:13:47.569597 28644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:13:47.569731 28644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:47.569841 28644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:13:47.569902 28644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:47.602662 28644 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:33835
I20260812 11:13:47.602742 28888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:33835 every 8 connection(s)
I20260812 11:13:47.604187 28644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:13:47.612890 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 28644
I20260812 11:13:47.613719 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:40569
--local_ip_for_outbound_sockets=127.4.26.66
--tserver_master_addrs=127.4.26.126:43003
--webserver_port=44573
--webserver_interface=127.4.26.66
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:13:47 dist-test-slave-rmhg krb5kdc[27512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533227, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:13:47.630937 28894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:47.607357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:57673 (local address 127.4.26.126:43003)
0812 11:13:47.607947 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:47.607959 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:47.608651 (+ 692us) server_negotiation.cc:407] Connection header received
0812 11:13:47.610867 (+ 2216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:47.610881 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:47.611284 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:47.611635 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:47.613268 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:47.615223 (+ 1955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:47.616958 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:47.618021 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:47.618216 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:47.622251 (+ 4035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:47.622263 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:47.622287 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:47.622349 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:47.625869 (+ 3520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:47.626979 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:47.626988 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:47.626995 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:47.627207 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:47.627734 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:47.627737 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:47.627739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:47.628251 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:47.628401 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:47.629529 (+ 1128us) server_negotiation.cc:299] Negotiation successful
0812 11:13:47.629894 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":239,"threads_started":1}
I20260812 11:13:47.631103 28896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:47.607508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:57673)
0812 11:13:47.608431 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:47.608485 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:47.610289 (+ 1804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:47.611796 (+ 1507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:47.611804 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:47.612363 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:47.612935 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:47.612953 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:47.615440 (+ 2487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:47.615445 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:47.616784 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:47.616799 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:47.618280 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:47.618286 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:47.618515 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:47.619252 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:47.619278 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:47.621860 (+ 2582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:47.626101 (+ 4241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:47.626113 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:47.626132 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:47.626794 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:47.627344 (+ 550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:47.627350 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:47.627354 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:47.627623 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:47.628415 (+ 792us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:47.628424 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:47.628850 (+ 426us) client_negotiation.cc:769] Sending connection context
0812 11:13:47.629217 (+ 367us) client_negotiation.cc:240] Negotiation successful
0812 11:13:47.629851 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":335,"threads_started":1}
I20260812 11:13:47.634217 28890 heartbeater.cc:347] Connected to a master server at 127.4.26.126:43003
I20260812 11:13:47.634582 28890 heartbeater.cc:464] Registering TS with master...
I20260812 11:13:47.635488 28890 heartbeater.cc:511] Master 127.4.26.126:43003 requested a full tablet report, sending...
I20260812 11:13:47.638280 28583 ts_manager.cc:194] Registered new tserver with Master: e2e8fadf1c9a467994be54a4353a8a85 (127.4.26.65:33835)
I20260812 11:13:47.640007 28583 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:57673
W20260812 11:13:47.966645 28897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:47.966953 28897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:47.967099 28897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:47.974632 28897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:47.974764 28897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:47.974921 28897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:13:47.985196 28897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:40569
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=44573
--tserver_master_addrs=127.4.26.126:43003
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:47.986627 28897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:47.988003 28897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:48.001739 28902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:48.001761 28906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:48.001693 28903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:48.006809 28897 server_base.cc:1034] running on GCE node
I20260812 11:13:48.007539 28897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:48.008610 28897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:48.009822 28897 hybrid_clock.cc:648] HybridClock initialized: now 1786533228009764 us; error 51 us; skew 500 ppm
I20260812 11:13:48.010144 28897 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:48 dist-test-slave-rmhg krb5kdc[27512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533228, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:48.013383 28897 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:13:48.014945 28897 webserver.cc:460] Webserver started at http://127.4.26.66:44573/ using document root <none> and password file <none>
I20260812 11:13:48.015681 28897 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:48.015820 28897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:48.021462 28897 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:13:48.024283 28916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:48.025755 28897 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:13:48.025915 28897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "4003f6472dc047dd99392acebf43aac4"
format_stamp: "Formatted at 2026-08-12 11:13:45 on dist-test-slave-rmhg"
server_key: "b87f931872269c7db14c393913240371"
server_key_iv: "6ebf9446b2e7ea6e65c32a443f1daa8f"
server_key_version: "encryptionkey@0"
I20260812 11:13:48.026935 28897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:48.040287 28897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:48.045452 28897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:48.045699 28897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:48.046694 28897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:13:48.048116 28897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:13:48.048208 28897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:48.048290 28897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:13:48.048349 28897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:48.077968 28897 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:40569
I20260812 11:13:48.078051 29095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:40569 every 8 connection(s)
I20260812 11:13:48.079439 28897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:13:48.088238 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 28897
I20260812 11:13:48.088959 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:44783
--local_ip_for_outbound_sockets=127.4.26.67
--tserver_master_addrs=127.4.26.126:43003
--webserver_port=43567
--webserver_interface=127.4.26.67
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:13:48 dist-test-slave-rmhg krb5kdc[27512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533228, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:13:48.101558 28894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.082312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:53001 (local address 127.4.26.126:43003)
0812 11:13:48.082490 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:48.082495 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:48.083697 (+ 1202us) server_negotiation.cc:407] Connection header received
0812 11:13:48.085611 (+ 1914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:48.085616 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:48.085700 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:48.085794 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:48.087531 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.088589 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.090416 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.091028 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.091179 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.094931 (+ 3752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:48.094939 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:48.094944 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:48.094989 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:48.098121 (+ 3132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:48.098959 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:48.098964 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:48.098967 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:48.099147 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:48.099659 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:48.099664 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:48.099666 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:48.099982 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:48.100127 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:48.100902 (+ 775us) server_negotiation.cc:299] Negotiation successful
0812 11:13:48.101200 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 11:13:48.102571 29101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.082717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:53001)
0812 11:13:48.083475 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:48.083549 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:48.085322 (+ 1773us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:48.086089 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:48.086099 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:48.086701 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:48.087319 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:48.087338 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.088775 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.088779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:48.090235 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:48.090251 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.091303 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.091309 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:48.091578 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.092316 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:48.092341 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:48.094683 (+ 2342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:48.098315 (+ 3632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:48.098324 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:48.098341 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:48.098814 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:48.099257 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:48.099260 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:48.099263 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:48.099508 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:48.100120 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:48.100129 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:48.100499 (+ 370us) client_negotiation.cc:769] Sending connection context
0812 11:13:48.100755 (+ 256us) client_negotiation.cc:240] Negotiation successful
0812 11:13:48.101368 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":302,"threads_started":1}
I20260812 11:13:48.104185 29097 heartbeater.cc:347] Connected to a master server at 127.4.26.126:43003
I20260812 11:13:48.104547 29097 heartbeater.cc:464] Registering TS with master...
I20260812 11:13:48.105494 29097 heartbeater.cc:511] Master 127.4.26.126:43003 requested a full tablet report, sending...
I20260812 11:13:48.107409 28583 ts_manager.cc:194] Registered new tserver with Master: 4003f6472dc047dd99392acebf43aac4 (127.4.26.66:40569)
I20260812 11:13:48.108490 28583 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:53001
W20260812 11:13:48.442175 29102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:48.442476 29102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:48.442574 29102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:48.450026 29102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:48.450222 29102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:48.450368 29102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:13:48.460533 29102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:44783
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=43567
--tserver_master_addrs=127.4.26.126:43003
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:48.462009 29102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:48.463370 29102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:48.477015 29108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:48.477064 29109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:48.477103 29111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:48.478214 29102 server_base.cc:1034] running on GCE node
I20260812 11:13:48.478979 29102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:48.480018 29102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:48.481249 29102 hybrid_clock.cc:648] HybridClock initialized: now 1786533228481196 us; error 46 us; skew 500 ppm
I20260812 11:13:48.481588 29102 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:48 dist-test-slave-rmhg krb5kdc[27512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533228, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:48.484809 29102 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:13:48.486337 29102 webserver.cc:460] Webserver started at http://127.4.26.67:43567/ using document root <none> and password file <none>
I20260812 11:13:48.487054 29102 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:48.487195 29102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:48.492862 29102 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260812 11:13:48.495936 29123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:48.497516 29102 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:13:48.497732 29102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "bb7141dc9ea44360847e2fb0114db788"
format_stamp: "Formatted at 2026-08-12 11:13:45 on dist-test-slave-rmhg"
server_key: "7c7f62cfc024151727fa8c1021a2be65"
server_key_iv: "ba876337029024e97e353561d7516648"
server_key_version: "encryptionkey@0"
I20260812 11:13:48.498749 29102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:48.522217 29102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:48.526969 29102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:48.527262 29102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:48.528358 29102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:13:48.529893 29102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:13:48.530006 29102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:48.530120 29102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:13:48.530191 29102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:48.562935 29102 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:44783
I20260812 11:13:48.562978 29314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:44783 every 8 connection(s)
I20260812 11:13:48.564459 29102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:13:48.571803 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 29102
Aug 12 11:13:48 dist-test-slave-rmhg krb5kdc[27512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533228, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:13:48.587607 29319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.572938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45948 (local address 127.4.26.126:43003)
0812 11:13:48.573482 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:48.573487 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:48.573831 (+ 344us) server_negotiation.cc:407] Connection header received
0812 11:13:48.573979 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:48.573984 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:48.574062 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:48.574174 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:48.575667 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.576482 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.578068 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.578514 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.578642 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.581307 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:48.581312 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:48.581315 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:48.581358 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:48.584246 (+ 2888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:48.585095 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:48.585100 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:48.585104 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:48.585286 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:48.585859 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:48.585863 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:48.585865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:48.586280 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:48.586546 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:48.586894 (+ 348us) server_negotiation.cc:299] Negotiation successful
0812 11:13:48.587166 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":411,"spinlock_wait_cycles":1408,"thread_start_us":293,"threads_started":1}
I20260812 11:13:48.587837 28894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.567398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:60013 (local address 127.4.26.126:43003)
0812 11:13:48.567621 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:48.567627 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:48.568911 (+ 1284us) server_negotiation.cc:407] Connection header received
0812 11:13:48.570957 (+ 2046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:48.570962 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:48.571042 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:48.571132 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:48.573417 (+ 2285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.574455 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.576069 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.576589 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.576705 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.580619 (+ 3914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:48.580624 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:48.580628 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:48.580664 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:48.583690 (+ 3026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:48.584749 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:48.584755 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:48.584759 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:48.584915 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:48.585493 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:48.585498 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:48.585500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:48.585904 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:48.586027 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:48.587205 (+ 1178us) server_negotiation.cc:299] Negotiation successful
0812 11:13:48.587416 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":69}
I20260812 11:13:48.589035 29318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.567892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:60013)
0812 11:13:48.568721 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:48.568764 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:48.570636 (+ 1872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:48.571530 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:48.571544 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:48.572371 (+ 827us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:13:48.573136 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:48.573205 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.574613 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.574617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:48.575909 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:48.575923 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.576845 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.576853 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:48.577123 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.577897 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:13:48.577930 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:13:48.580365 (+ 2435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:13:48.583893 (+ 3528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:48.583905 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:48.583927 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:48.584596 (+ 669us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:48.585021 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:13:48.585025 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:13:48.585029 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:13:48.585335 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:13:48.586064 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:13:48.586073 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:13:48.586667 (+ 594us) client_negotiation.cc:769] Sending connection context
0812 11:13:48.587045 (+ 378us) client_negotiation.cc:240] Negotiation successful
0812 11:13:48.587671 (+ 626us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":319,"threads_started":1}
I20260812 11:13:48.590869 29315 heartbeater.cc:347] Connected to a master server at 127.4.26.126:43003
I20260812 11:13:48.591167 29315 heartbeater.cc:464] Registering TS with master...
I20260812 11:13:48.591884 29315 heartbeater.cc:511] Master 127.4.26.126:43003 requested a full tablet report, sending...
I20260812 11:13:48.593578 28583 ts_manager.cc:194] Registered new tserver with Master: bb7141dc9ea44360847e2fb0114db788 (127.4.26.67:44783)
I20260812 11:13:48.594573 28583 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:60013
I20260812 11:13:48.603063 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:13:48.611248 29319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.604227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45950 (local address 127.4.26.126:43003)
0812 11:13:48.604464 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:48.604469 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:48.604820 (+ 351us) server_negotiation.cc:407] Connection header received
0812 11:13:48.605113 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:48.605117 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:48.605309 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:48.605436 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:13:48.606026 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.606959 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.608861 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.609395 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.609498 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.610105 (+ 607us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:13:48.610653 (+ 548us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:13:48.610779 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:48.610891 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 11:13:48.610969 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 11:13:48.612327 28583 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:45950:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:13:48.619624 28583 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:13:48.642410 29337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.632091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49554 (local address 127.4.26.65:33835)
0812 11:13:48.632875 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:48.632884 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:48.634436 (+ 1552us) server_negotiation.cc:407] Connection header received
0812 11:13:48.634767 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:48.634777 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:48.635073 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:48.635250 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:13:48.636289 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.637775 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.639545 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.641091 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.641266 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.641519 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:48.641894 (+ 375us) server_negotiation.cc:299] Negotiation successful
0812 11:13:48.642078 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":385,"threads_started":1}
I20260812 11:13:48.642481 29336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.631976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33835 (local address 127.0.0.1:49554)
0812 11:13:48.634244 (+ 2268us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:48.634301 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:48.634553 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:48.635599 (+ 1046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:48.635608 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:48.635640 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:13:48.636033 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:48.636047 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.637918 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.637922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:48.639382 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:48.639395 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.641344 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.641351 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:48.641618 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.641691 (+ 73us) client_negotiation.cc:769] Sending connection context
0812 11:13:48.641829 (+ 138us) client_negotiation.cc:240] Negotiation successful
0812 11:13:48.642038 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1012,"mutex_wait_us":27,"thread_start_us":1177,"threads_started":1}
I20260812 11:13:48.644426 28890 heartbeater.cc:503] Master 127.4.26.126:43003 was elected leader, sending a full tablet report...
I20260812 11:13:48.644893 29339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.632334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:40569 (local address 127.0.0.1:34218)
0812 11:13:48.634286 (+ 1952us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:48.634306 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:48.634497 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:48.636739 (+ 2242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:48.636745 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:48.636789 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:13:48.637444 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:48.637455 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.639637 (+ 2182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.639643 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:48.641991 (+ 2348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:48.642006 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.643871 (+ 1865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.643878 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:48.644123 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.644148 (+ 25us) client_negotiation.cc:769] Sending connection context
0812 11:13:48.644246 (+ 98us) client_negotiation.cc:240] Negotiation successful
0812 11:13:48.644381 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1818,"mutex_wait_us":215,"spinlock_wait_cycles":5248,"thread_start_us":2471,"threads_started":1}
I20260812 11:13:48.645012 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.632638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:44783 (local address 127.0.0.1:47000)
0812 11:13:48.635076 (+ 2438us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:48.635096 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:48.635210 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:48.636740 (+ 1530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:48.636745 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:48.636781 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:13:48.637385 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:48.637399 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.639697 (+ 2298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.639701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:48.642166 (+ 2465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:48.642186 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.644023 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.644030 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:48.644228 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.644261 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 11:13:48.644330 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 11:13:48.644481 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2319,"mutex_wait_us":95,"spinlock_wait_cycles":1280,"thread_start_us":1370,"threads_started":1}
I20260812 11:13:48.645787 29340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.632866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34218 (local address 127.4.26.66:40569)
0812 11:13:48.636137 (+ 3271us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:48.636145 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:48.636177 (+ 32us) server_negotiation.cc:407] Connection header received
0812 11:13:48.636274 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:48.636281 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:48.636515 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:48.637610 (+ 1095us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:13:48.637852 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.639450 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.642202 (+ 2752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.643646 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.643770 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.643983 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:48.645287 (+ 1304us) server_negotiation.cc:299] Negotiation successful
0812 11:13:48.645473 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2686,"thread_start_us":2591,"threads_started":1}
I20260812 11:13:48.646140 29341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.633315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47000 (local address 127.4.26.67:44783)
0812 11:13:48.636162 (+ 2847us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:48.636169 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:48.636197 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:13:48.636275 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:48.636281 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:48.636515 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:48.637597 (+ 1082us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:13:48.637895 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.639477 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.642380 (+ 2903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.643753 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.645273 (+ 1520us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.645522 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:48.645629 (+ 107us) server_negotiation.cc:299] Negotiation successful
0812 11:13:48.645808 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2673,"thread_start_us":2494,"threads_started":1}
I20260812 11:13:48.648038 28787 tablet_service.cc:1467] Processing CreateTablet for tablet 2b4f11c8e14d4772a1309070b2195396 (DEFAULT_TABLE table=test-table [id=133c7547dddb464db0170f990841cfce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:13:48.649667 28787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b4f11c8e14d4772a1309070b2195396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:13:48.649502 29209 tablet_service.cc:1467] Processing CreateTablet for tablet 2b4f11c8e14d4772a1309070b2195396 (DEFAULT_TABLE table=test-table [id=133c7547dddb464db0170f990841cfce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:13:48.649576 28989 tablet_service.cc:1467] Processing CreateTablet for tablet 2b4f11c8e14d4772a1309070b2195396 (DEFAULT_TABLE table=test-table [id=133c7547dddb464db0170f990841cfce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:13:48.650853 29209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b4f11c8e14d4772a1309070b2195396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:13:48.650959 28989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b4f11c8e14d4772a1309070b2195396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:13:48.663004 29343 tablet_bootstrap.cc:492] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788: Bootstrap starting.
I20260812 11:13:48.665488 29346 tablet_bootstrap.cc:492] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85: Bootstrap starting.
I20260812 11:13:48.668949 29346 tablet_bootstrap.cc:654] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85: Neither blocks nor log segments found. Creating new log.
I20260812 11:13:48.668949 29343 tablet_bootstrap.cc:654] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788: Neither blocks nor log segments found. Creating new log.
I20260812 11:13:48.670426 29343 log.cc:824] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:48.670495 29346 log.cc:824] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:48.671837 29347 tablet_bootstrap.cc:492] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4: Bootstrap starting.
I20260812 11:13:48.674296 29343 tablet_bootstrap.cc:492] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788: No bootstrap required, opened a new log
I20260812 11:13:48.674427 29346 tablet_bootstrap.cc:492] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85: No bootstrap required, opened a new log
I20260812 11:13:48.674599 29343 ts_tablet_manager.cc:1397] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.001s
I20260812 11:13:48.674750 29346 ts_tablet_manager.cc:1397] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260812 11:13:48.675715 29347 tablet_bootstrap.cc:654] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4: Neither blocks nor log segments found. Creating new log.
I20260812 11:13:48.677060 29347 log.cc:824] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:48.680439 29347 tablet_bootstrap.cc:492] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4: No bootstrap required, opened a new log
I20260812 11:13:48.680733 29347 ts_tablet_manager.cc:1397] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260812 11:13:48.682583 29346 raft_consensus.cc:348] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } } peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } }
I20260812 11:13:48.682960 29346 raft_consensus.cc:374] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:13:48.683073 29346 raft_consensus.cc:729] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2e8fadf1c9a467994be54a4353a8a85, State: Initialized, Role: FOLLOWER
I20260812 11:13:48.683663 29346 consensus_queue.cc:260] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } } peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } }
I20260812 11:13:48.684960 29343 raft_consensus.cc:348] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } } peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } }
I20260812 11:13:48.685418 29343 raft_consensus.cc:374] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:13:48.685426 29346 ts_tablet_manager.cc:1428] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85: Time spent starting tablet: real 0.011s user 0.002s sys 0.010s
I20260812 11:13:48.685511 29343 raft_consensus.cc:729] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb7141dc9ea44360847e2fb0114db788, State: Initialized, Role: FOLLOWER
I20260812 11:13:48.686102 29343 consensus_queue.cc:260] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } } peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } }
I20260812 11:13:48.687568 29315 heartbeater.cc:503] Master 127.4.26.126:43003 was elected leader, sending a full tablet report...
I20260812 11:13:48.688807 29343 ts_tablet_manager.cc:1428] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788: Time spent starting tablet: real 0.014s user 0.006s sys 0.008s
I20260812 11:13:48.690874 29347 raft_consensus.cc:348] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } } peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } }
I20260812 11:13:48.691337 29347 raft_consensus.cc:374] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:13:48.691461 29347 raft_consensus.cc:729] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4003f6472dc047dd99392acebf43aac4, State: Initialized, Role: FOLLOWER
I20260812 11:13:48.692101 29347 consensus_queue.cc:260] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } } peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } }
I20260812 11:13:48.693128 29097 heartbeater.cc:503] Master 127.4.26.126:43003 was elected leader, sending a full tablet report...
I20260812 11:13:48.693657 29347 ts_tablet_manager.cc:1428] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260812 11:13:48.783767 29356 raft_consensus.cc:482] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:13:48.784183 29356 raft_consensus.cc:504] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } } peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } }
I20260812 11:13:48.786144 29356 leader_election.cc:288] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2e8fadf1c9a467994be54a4353a8a85 (127.4.26.65:33835), bb7141dc9ea44360847e2fb0114db788 (127.4.26.67:44783)
I20260812 11:13:48.793768 29341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.786694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:45141 (local address 127.4.26.67:44783)
0812 11:13:48.786936 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:48.786943 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:48.787860 (+ 917us) server_negotiation.cc:407] Connection header received
0812 11:13:48.788035 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:48.788040 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:48.788111 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:48.788190 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:13:48.788842 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.789641 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.791727 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.792738 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.792877 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.792984 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:48.793364 (+ 380us) server_negotiation.cc:299] Negotiation successful
0812 11:13:48.793505 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260812 11:13:48.793805 29337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.786744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:43289 (local address 127.4.26.65:33835)
0812 11:13:48.787172 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:48.787180 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:48.787553 (+ 373us) server_negotiation.cc:407] Connection header received
0812 11:13:48.787777 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:48.787781 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:48.787860 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:48.787949 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:13:48.788562 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.789376 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.791493 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.792518 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.792646 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.792733 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:48.793371 (+ 638us) server_negotiation.cc:299] Negotiation successful
0812 11:13:48.793515 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247}
I20260812 11:13:48.793944 29358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.786720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:44783 (local address 127.4.26.66:45141)
0812 11:13:48.787736 (+ 1016us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:48.787756 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:48.787877 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:48.788229 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:48.788233 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:48.788263 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:13:48.788668 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:48.788678 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.789786 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.789791 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:48.791542 (+ 1751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:48.791557 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.792968 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.792973 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:48.793190 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.793226 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:13:48.793316 (+ 90us) client_negotiation.cc:240] Negotiation successful
0812 11:13:48.793508 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":896,"mutex_wait_us":77,"thread_start_us":689,"threads_started":1}
I20260812 11:13:48.794032 29357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.786454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33835 (local address 127.4.26.66:43289)
0812 11:13:48.787421 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:48.787439 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:13:48.787621 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:13:48.787971 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:13:48.787976 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:13:48.788021 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:13:48.788400 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:48.788409 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.789513 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.789519 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:48.791253 (+ 1734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:13:48.791268 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.792786 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.792793 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:13:48.793087 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.793183 (+ 96us) client_negotiation.cc:769] Sending connection context
0812 11:13:48.793318 (+ 135us) client_negotiation.cc:240] Negotiation successful
0812 11:13:48.793524 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":836,"mutex_wait_us":48,"thread_start_us":560,"threads_started":1}
I20260812 11:13:48.795186 28818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b4f11c8e14d4772a1309070b2195396" candidate_uuid: "4003f6472dc047dd99392acebf43aac4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2e8fadf1c9a467994be54a4353a8a85" is_pre_election: true
I20260812 11:13:48.795532 29244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b4f11c8e14d4772a1309070b2195396" candidate_uuid: "4003f6472dc047dd99392acebf43aac4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7141dc9ea44360847e2fb0114db788" is_pre_election: true
I20260812 11:13:48.795733 28818 raft_consensus.cc:2454] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4003f6472dc047dd99392acebf43aac4 in term 0.
I20260812 11:13:48.796028 29244 raft_consensus.cc:2454] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4003f6472dc047dd99392acebf43aac4 in term 0.
I20260812 11:13:48.796517 28918 leader_election.cc:302] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4003f6472dc047dd99392acebf43aac4, e2e8fadf1c9a467994be54a4353a8a85; no voters:
I20260812 11:13:48.797042 29356 raft_consensus.cc:2781] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:13:48.797277 29356 raft_consensus.cc:482] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:13:48.797402 29356 raft_consensus.cc:3037] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:13:48.799772 29356 raft_consensus.cc:504] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } } peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } }
I20260812 11:13:48.800462 29356 leader_election.cc:288] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [CANDIDATE]: Term 1 election: Requested vote from peers e2e8fadf1c9a467994be54a4353a8a85 (127.4.26.65:33835), bb7141dc9ea44360847e2fb0114db788 (127.4.26.67:44783)
I20260812 11:13:48.801219 28818 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b4f11c8e14d4772a1309070b2195396" candidate_uuid: "4003f6472dc047dd99392acebf43aac4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2e8fadf1c9a467994be54a4353a8a85"
I20260812 11:13:48.801241 29244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b4f11c8e14d4772a1309070b2195396" candidate_uuid: "4003f6472dc047dd99392acebf43aac4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb7141dc9ea44360847e2fb0114db788"
I20260812 11:13:48.801476 28818 raft_consensus.cc:3037] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:13:48.801476 29244 raft_consensus.cc:3037] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:13:48.804044 29244 raft_consensus.cc:2454] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4003f6472dc047dd99392acebf43aac4 in term 1.
I20260812 11:13:48.804082 28818 raft_consensus.cc:2454] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4003f6472dc047dd99392acebf43aac4 in term 1.
I20260812 11:13:48.804615 28918 leader_election.cc:302] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4003f6472dc047dd99392acebf43aac4, bb7141dc9ea44360847e2fb0114db788, e2e8fadf1c9a467994be54a4353a8a85; no voters:
I20260812 11:13:48.805001 29356 raft_consensus.cc:2781] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:13:48.805502 29356 raft_consensus.cc:686] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [term 1 LEADER]: Becoming Leader. State: Replica: 4003f6472dc047dd99392acebf43aac4, State: Running, Role: LEADER
I20260812 11:13:48.806070 29356 consensus_queue.cc:237] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } } peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } }
I20260812 11:13:48.811256 28581 catalog_manager.cc:5495] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4003f6472dc047dd99392acebf43aac4 (127.4.26.66). New cstate: current_term: 1 leader_uuid: "4003f6472dc047dd99392acebf43aac4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4003f6472dc047dd99392acebf43aac4" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 40569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 } health_report { overall_health: UNKNOWN } } }
W20260812 11:13:48.816241 29317 tablet.cc:2369] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:13:48.831529 29098 tablet.cc:2369] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:13:48.844054 29340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.838387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34230 (local address 127.4.26.66:40569)
0812 11:13:48.838610 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:48.838616 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:48.838654 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:13:48.838886 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:48.838891 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:48.838971 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:48.839126 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:13:48.839503 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.840247 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.841787 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.842215 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.842328 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.842868 (+ 540us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:13:48.843405 (+ 537us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:13:48.843545 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:48.843656 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 11:13:48.843744 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 11:13:48.853477 29244 raft_consensus.cc:1261] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788 [term 1 FOLLOWER]: Refusing update from remote peer 4003f6472dc047dd99392acebf43aac4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:13:48.853487 28818 raft_consensus.cc:1261] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85 [term 1 FOLLOWER]: Refusing update from remote peer 4003f6472dc047dd99392acebf43aac4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:13:48.854465 29359 consensus_queue.cc:1035] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb7141dc9ea44360847e2fb0114db788" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:13:48.854831 29356 consensus_queue.cc:1035] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2e8fadf1c9a467994be54a4353a8a85" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:13:48.856683 28892 tablet.cc:2369] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:13:48.866794 29366 mvcc.cc:205] Tried to move back new op lower bound from 7317640105372499968 to 7317640105194328064. Current Snapshot: MvccSnapshot[applied={T|T < 7317640105372499968}]
I20260812 11:13:48.884217 28581 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:45950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:13:48.884608 28581 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:45950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:13:48.889091 28581 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c: Sending DeleteTablet for 3 replicas of tablet 2b4f11c8e14d4772a1309070b2195396
I20260812 11:13:48.890440 28787 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b4f11c8e14d4772a1309070b2195396 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:13:48 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:49554
I20260812 11:13:48.890404 28989 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b4f11c8e14d4772a1309070b2195396 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:13:48 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:34218
I20260812 11:13:48.891389 29381 tablet_replica.cc:330] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85: stopping tablet replica
I20260812 11:13:48.891211 29209 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b4f11c8e14d4772a1309070b2195396 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:13:48 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:47000
I20260812 11:13:48.891757 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 28644
I20260812 11:13:48.892190 29383 tablet_replica.cc:330] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4: stopping tablet replica
I20260812 11:13:48.892927 29385 tablet_replica.cc:330] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788: stopping tablet replica
I20260812 11:13:48.893505 29385 raft_consensus.cc:2229] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:13:48.894033 29381 raft_consensus.cc:2229] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:13:48.894086 29385 raft_consensus.cc:2258] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:13:48.894563 29383 raft_consensus.cc:2229] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:13:48.895263 29383 raft_consensus.cc:2258] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:13:48.896066 29381 raft_consensus.cc:2258] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:13:48.897917 29383 ts_tablet_manager.cc:1905] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:13:48.899807 29381 ts_tablet_manager.cc:1905] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:13:48.902735 29385 ts_tablet_manager.cc:1905] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:13:48.905594 29383 ts_tablet_manager.cc:1918] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:13:48.905786 29383 log.cc:1196] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/2b4f11c8e14d4772a1309070b2195396
I20260812 11:13:48.906342 29383 ts_tablet_manager.cc:1939] T 2b4f11c8e14d4772a1309070b2195396 P 4003f6472dc047dd99392acebf43aac4: Deleting consensus metadata
I20260812 11:13:48.908353 28558 catalog_manager.cc:4841] TS 4003f6472dc047dd99392acebf43aac4 (127.4.26.66:40569): tablet 2b4f11c8e14d4772a1309070b2195396 (table test-table [id=133c7547dddb464db0170f990841cfce]) successfully deleted
I20260812 11:13:48.910226 29337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:48.892848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49562 (local address 127.4.26.65:33835)
0812 11:13:48.893016 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:48.893022 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:48.893125 (+ 103us) server_negotiation.cc:407] Connection header received
0812 11:13:48.893334 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:48.893339 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:48.893433 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:48.893523 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:48.895299 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.896549 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.898358 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:48.898996 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:48.899137 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:48.902784 (+ 3647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:48.902801 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:48.902823 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:48.902868 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:48.906832 (+ 3964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:48.907782 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:48.907792 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:48.907795 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:48.907959 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:48.908379 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:48.908384 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:48.908387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:48.908909 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:48.909288 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:48.909586 (+ 298us) server_negotiation.cc:299] Negotiation successful
0812 11:13:48.909819 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 11:13:48.910912 28882 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:48.916446 29385 ts_tablet_manager.cc:1918] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:13:48.916625 29385 log.cc:1196] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/2b4f11c8e14d4772a1309070b2195396
I20260812 11:13:48.917119 29385 ts_tablet_manager.cc:1939] T 2b4f11c8e14d4772a1309070b2195396 P bb7141dc9ea44360847e2fb0114db788: Deleting consensus metadata
I20260812 11:13:48.918844 28564 catalog_manager.cc:4841] TS bb7141dc9ea44360847e2fb0114db788 (127.4.26.67:44783): tablet 2b4f11c8e14d4772a1309070b2195396 (table test-table [id=133c7547dddb464db0170f990841cfce]) successfully deleted
I20260812 11:13:49.021536 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 28644
I20260812 11:13:49.046437 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 28897
W20260812 11:13:49.046898 28556 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.26.65:33835 (error 108)
I20260812 11:13:49.056651 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:49.056003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33835 (local address 127.0.0.1:49568)
0812 11:13:49.056316 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:49.056448 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187}
W20260812 11:13:49.056929 28556 catalog_manager.cc:4584] TS e2e8fadf1c9a467994be54a4353a8a85 (127.4.26.65:33835): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2b4f11c8e14d4772a1309070b2195396: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33835: connect: Connection refused (error 111)
I20260812 11:13:49.065730 29340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:49.047902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34240 (local address 127.4.26.66:40569)
0812 11:13:49.048513 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:49.048519 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:49.048539 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:13:49.048612 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:49.048618 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:49.048710 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:49.048818 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:49.051023 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:49.052340 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:49.054363 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:49.055081 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:49.055217 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:49.058936 (+ 3719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:49.058952 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:49.058969 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:49.059016 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:49.062392 (+ 3376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:49.063437 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:49.063445 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:49.063447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:49.063612 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:49.064085 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:49.064089 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:49.064092 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:49.064517 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:49.064783 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:49.065142 (+ 359us) server_negotiation.cc:299] Negotiation successful
0812 11:13:49.065377 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457}
I20260812 11:13:49.066601 29090 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:49.110816 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:49.110307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33835 (local address 127.0.0.1:49570)
0812 11:13:49.110544 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:49.110649 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260812 11:13:49.112048 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:49.111588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33835 (local address 127.0.0.1:49580)
0812 11:13:49.111827 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:49.111920 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143}
I20260812 11:13:49.172596 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:49.172073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33835 (local address 127.0.0.1:49584)
0812 11:13:49.172308 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:49.172412 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260812 11:13:49.173676 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:49.173332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33835 (local address 127.0.0.1:49596)
0812 11:13:49.173467 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:49.173552 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260812 11:13:49.190847 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 28897
I20260812 11:13:49.212706 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 29102
I20260812 11:13:49.228081 29341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:49.213635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47012 (local address 127.4.26.67:44783)
0812 11:13:49.213801 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 11:13:49.213806 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:13:49.213825 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:13:49.213915 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:13:49.213919 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:13:49.213984 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:13:49.214110 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:13:49.215677 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:49.216469 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:49.218278 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:13:49.218764 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:13:49.218885 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:13:49.221829 (+ 2944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:13:49.221855 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:13:49.221880 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:13:49.221936 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:13:49.224829 (+ 2893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:49.225758 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:49.225766 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:49.225769 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:49.225929 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:13:49.226416 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:13:49.226420 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:13:49.226422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:13:49.226833 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:13:49.227072 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0812 11:13:49.227584 (+ 512us) server_negotiation.cc:299] Negotiation successful
0812 11:13:49.227785 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:13:49.228768 29306 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:49.254287 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:49.253757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33835 (local address 127.0.0.1:49606)
0812 11:13:49.253976 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:49.254092 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260812 11:13:49.255507 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:49.255085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33835 (local address 127.0.0.1:49610)
0812 11:13:49.255302 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:49.255390 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260812 11:13:49.319248 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 29102
I20260812 11:13:49.344961 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 28518
I20260812 11:13:49.346246 28629 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:13:49.462087 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 28518
I20260812 11:13:49.462170 29338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:49.461582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33835 (local address 127.0.0.1:49624)
0812 11:13:49.461812 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:49.461908 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 11:13:49.492148 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:43003
--webserver_interface=127.4.26.126
--webserver_port=44341
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:43003
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:13:49.847131 29392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:49.847465 29392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:49.847558 29392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:49.855633 29392 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:13:49.855785 29392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:49.855834 29392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:49.855893 29392 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:13:49.855938 29392 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:13:49.866942 29392 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:43003
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:43003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=44341
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:49.868422 29392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:49.869946 29392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:49.883358 29407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:49.883345 29403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:49.883394 29402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:49.884377 29392 server_base.cc:1034] running on GCE node
I20260812 11:13:49.885356 29392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:49.886996 29392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:49.888293 29392 hybrid_clock.cc:648] HybridClock initialized: now 1786533229888229 us; error 55 us; skew 500 ppm
I20260812 11:13:49.888762 29392 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:49 dist-test-slave-rmhg krb5kdc[27512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533229, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:49.892457 29392 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:13:49.894341 29392 webserver.cc:460] Webserver started at http://127.4.26.126:44341/ using document root <none> and password file <none>
I20260812 11:13:49.895133 29392 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:49.895277 29392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:49.901759 29392 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:13:49.905004 29416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:49.906665 29392 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:13:49.906870 29392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "d4f4200d3ab347c1b41864c16c72b37c"
format_stamp: "Formatted at 2026-08-12 11:13:43 on dist-test-slave-rmhg"
server_key: "62e46ba06fecdb11ade5faaaaa7d8c86"
server_key_iv: "77b389e1bf4a86f2d3c5b10a72d4113a"
server_key_version: "encryptionkey@0"
I20260812 11:13:49.908020 29392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:49.930927 29392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:49.935448 29392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:49.935727 29392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:49.954300 29392 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:43003
I20260812 11:13:49.954344 29498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:43003 every 8 connection(s)
I20260812 11:13:49.955901 29392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:13:49.962517 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 29392
I20260812 11:13:49.963289 29499 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:13:49.963413 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:33835
--local_ip_for_outbound_sockets=127.4.26.65
--tserver_master_addrs=127.4.26.126:43003
--webserver_port=45073
--webserver_interface=127.4.26.65
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:13:49.966892 29499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c: Bootstrap starting.
I20260812 11:13:49.991461 29499 log.cc:824] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:13:50.014590 29499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:13:50.015282 29499 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c: Bootstrap complete.
I20260812 11:13:50.028738 29499 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } }
I20260812 11:13:50.030143 29499 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4f4200d3ab347c1b41864c16c72b37c, State: Initialized, Role: FOLLOWER
I20260812 11:13:50.030923 29499 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } }
I20260812 11:13:50.031227 29499 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:13:50.031359 29499 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:13:50.031539 29499 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 2 FOLLOWER]: Advancing to term 3
I20260812 11:13:50.037422 29499 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } }
I20260812 11:13:50.037964 29499 leader_election.cc:302] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4f4200d3ab347c1b41864c16c72b37c; no voters:
I20260812 11:13:50.038607 29499 leader_election.cc:288] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 11:13:50.038802 29504 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 3 FOLLOWER]: Leader election won for term 3
I20260812 11:13:50.039844 29504 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [term 3 LEADER]: Becoming Leader. State: Replica: d4f4200d3ab347c1b41864c16c72b37c, State: Running, Role: LEADER
I20260812 11:13:50.040406 29504 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } }
I20260812 11:13:50.041016 29499 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:13:50.043226 29509 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4f4200d3ab347c1b41864c16c72b37c. Latest consensus state: current_term: 3 leader_uuid: "d4f4200d3ab347c1b41864c16c72b37c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } } }
I20260812 11:13:50.043642 29509 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [sys.catalog]: This master's current role is: LEADER
I20260812 11:13:50.044148 29508 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "d4f4200d3ab347c1b41864c16c72b37c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4f4200d3ab347c1b41864c16c72b37c" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 43003 } } }
I20260812 11:13:50.044425 29508 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4f4200d3ab347c1b41864c16c72b37c [sys.catalog]: This master's current role is: LEADER
I20260812 11:13:50.049816 29513 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:13:50.058830 29513 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:13:50.060412 29513 catalog_manager.cc:1259] Loaded cluster ID: 4cc12389e41c429988e8e83c2136d5ea
I20260812 11:13:50.060586 29513 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260812 11:13:50.062793 29513 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc22fa5e9ad google::LogMessage::Fail() at ??:0
@ 0x7fc22fa6188a google::LogMessage::SendToLog() at ??:0
@ 0x7fc22fa5e4de google::LogMessage::Flush() at ??:0
@ 0x7fc22fa5fa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20260812 11:13:50.071935 29538 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7fc245491512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fc24548e976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fc245516610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fc245516439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fc2326aa345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc2326ad91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fc2326ad799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fc232688eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc2359626db start_thread at ??:0
@ 0x7fc22e8f861f clone at ??:0
W20260812 11:13:50.367807 29501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:50.368141 29501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:50.368273 29501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:50.376345 29501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:50.376523 29501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:50.376715 29501 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:13:50.389287 29501 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:33835
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=45073
--tserver_master_addrs=127.4.26.126:43003
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:50.390681 29501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:50.392076 29501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:50.405821 29572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:50.405876 29578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:50.405900 29574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:50.406895 29501 server_base.cc:1034] running on GCE node
I20260812 11:13:50.407541 29501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:50.408545 29501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:50.409783 29501 hybrid_clock.cc:648] HybridClock initialized: now 1786533230409724 us; error 44 us; skew 500 ppm
I20260812 11:13:50.410131 29501 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:50 dist-test-slave-rmhg krb5kdc[27512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533230, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:50.413524 29501 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:13:50.415107 29501 webserver.cc:460] Webserver started at http://127.4.26.65:45073/ using document root <none> and password file <none>
I20260812 11:13:50.415829 29501 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:50.415957 29501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:50.421721 29501 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:13:50.425102 29592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:50.426632 29501 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:13:50.426807 29501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "e2e8fadf1c9a467994be54a4353a8a85"
format_stamp: "Formatted at 2026-08-12 11:13:44 on dist-test-slave-rmhg"
server_key: "c35558ed393a69f34f174c8548dac826"
server_key_iv: "aa4f349b057be13f8d7b5e28f0b5f8d0"
server_key_version: "encryptionkey@0"
I20260812 11:13:50.427834 29501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:50.456858 29501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:50.461812 29501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:50.462072 29501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:50.463150 29501 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:13:50.465201 29607 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260812 11:13:50.471329 29607 ts_tablet_manager.cc:1852] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260812 11:13:50.472479 29607 ts_tablet_manager.cc:1905] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:13:50.480852 29607 ts_tablet_manager.cc:1918] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:13:50.481099 29607 log.cc:1196] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/2b4f11c8e14d4772a1309070b2195396
I20260812 11:13:50.481639 29607 ts_tablet_manager.cc:1939] T 2b4f11c8e14d4772a1309070b2195396 P e2e8fadf1c9a467994be54a4353a8a85: Deleting consensus metadata
I20260812 11:13:50.482080 29501 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260812 11:13:50.482221 29501 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.017s user 0.001s sys 0.000s
I20260812 11:13:50.482364 29501 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:13:50.482447 29501 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:50.517023 29501 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:33835
I20260812 11:13:50.517107 29780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:33835 every 8 connection(s)
I20260812 11:13:50.518474 29501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:13:50.523774 29787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:50.521763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:46133)
0812 11:13:50.522570 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:50.522799 (+ 229us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":321,"threads_started":1}
W20260812 11:13:50.524650 29783 heartbeater.cc:644] Failed to heartbeat to 127.4.26.126:43003 (0 consecutive failures): Network error: Failed to ping master at 127.4.26.126:43003: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
I20260812 11:13:50.525122 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 29501
I20260812 11:13:50.525738 29787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:50.525287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:39467)
0812 11:13:50.525482 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:50.525587 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260812 11:13:50.525947 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:40569
--local_ip_for_outbound_sockets=127.4.26.66
--tserver_master_addrs=127.4.26.126:43003
--webserver_port=44573
--webserver_interface=127.4.26.66
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:13:50.526768 29787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:50.526346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:34491)
0812 11:13:50.526506 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:50.526606 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 11:13:50.527016 29783 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:13:50.870994 29788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:50.871304 29788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:50.871428 29788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:50.878773 29788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:50.878898 29788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:50.879050 29788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:13:50.889073 29788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:40569
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=44573
--tserver_master_addrs=127.4.26.126:43003
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:50.890475 29788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:50.891852 29788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:50.905759 29798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:50.905721 29799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:50.905787 29802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:50.906433 29788 server_base.cc:1034] running on GCE node
I20260812 11:13:50.907148 29788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:50.908133 29788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:50.909341 29788 hybrid_clock.cc:648] HybridClock initialized: now 1786533230909280 us; error 45 us; skew 500 ppm
I20260812 11:13:50.909722 29788 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:50 dist-test-slave-rmhg krb5kdc[27512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533230, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:50.913340 29788 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:13:50.914855 29788 webserver.cc:460] Webserver started at http://127.4.26.66:44573/ using document root <none> and password file <none>
I20260812 11:13:50.915587 29788 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:50.915699 29788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:50.921489 29788 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260812 11:13:50.924445 29812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:50.926079 29788 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:13:50.926239 29788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "4003f6472dc047dd99392acebf43aac4"
format_stamp: "Formatted at 2026-08-12 11:13:45 on dist-test-slave-rmhg"
server_key: "b87f931872269c7db14c393913240371"
server_key_iv: "6ebf9446b2e7ea6e65c32a443f1daa8f"
server_key_version: "encryptionkey@0"
I20260812 11:13:50.927238 29788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:50.948572 29788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:50.953451 29788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:50.953713 29788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:50.954725 29788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:13:50.956171 29788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:13:50.956275 29788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:50.956363 29788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:13:50.956418 29788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:50.987466 29788 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:40569
I20260812 11:13:50.987514 29986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:40569 every 8 connection(s)
I20260812 11:13:50.988974 29788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:13:50.994186 29992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:50.992103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:48939)
0812 11:13:50.992915 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:50.993210 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":326,"threads_started":1}
W20260812 11:13:50.995003 29988 heartbeater.cc:644] Failed to heartbeat to 127.4.26.126:43003 (0 consecutive failures): Network error: Failed to ping master at 127.4.26.126:43003: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
I20260812 11:13:50.995903 29992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:50.995540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:44949)
0812 11:13:50.995714 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:50.995790 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260812 11:13:50.995986 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 29788
I20260812 11:13:50.996735 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:44783
--local_ip_for_outbound_sockets=127.4.26.67
--tserver_master_addrs=127.4.26.126:43003
--webserver_port=43567
--webserver_interface=127.4.26.67
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:45719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:13:50.996888 29992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:50.996538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:46243)
0812 11:13:50.996677 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:50.996757 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260812 11:13:50.997146 29988 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:13:51.344784 29993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:13:51.345103 29993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:13:51.345256 29993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:13:51.352814 29993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:13:51.352957 29993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:13:51.353113 29993 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:13:51.363476 29993 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:45719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:44783
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=43567
--tserver_master_addrs=127.4.26.126:43003
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:13:51.364902 29993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:13:51.366354 29993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:13:51.380216 30005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:51.380185 30008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:13:51.380246 30015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:13:51.381498 29993 server_base.cc:1034] running on GCE node
I20260812 11:13:51.382229 29993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:13:51.383334 29993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:13:51.384546 29993 hybrid_clock.cc:648] HybridClock initialized: now 1786533231384505 us; error 70 us; skew 500 ppm
I20260812 11:13:51.384891 29993 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:13:51 dist-test-slave-rmhg krb5kdc[27512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533231, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:13:51.388413 29993 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:13:51.390273 29993 webserver.cc:460] Webserver started at http://127.4.26.67:43567/ using document root <none> and password file <none>
I20260812 11:13:51.391072 29993 fs_manager.cc:359] Metadata directory not provided
I20260812 11:13:51.391201 29993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:13:51.397500 29993 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:13:51.400748 30023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:51.402369 29993 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:13:51.402618 29993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "bb7141dc9ea44360847e2fb0114db788"
format_stamp: "Formatted at 2026-08-12 11:13:45 on dist-test-slave-rmhg"
server_key: "7c7f62cfc024151727fa8c1021a2be65"
server_key_iv: "ba876337029024e97e353561d7516648"
server_key_version: "encryptionkey@0"
I20260812 11:13:51.403699 29993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:13:51.424412 29993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:13:51.429000 29993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:13:51.429315 29993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:13:51.430414 29993 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:13:51.431943 29993 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:13:51.432062 29993 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:51.432179 29993 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:13:51.432247 29993 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:13:51.464592 29993 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:44783
I20260812 11:13:51.464654 30211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:44783 every 8 connection(s)
I20260812 11:13:51.466100 29993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:13:51.471201 30219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:51.469196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:44739)
0812 11:13:51.469974 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:51.470197 (+ 223us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":293,"threads_started":1}
W20260812 11:13:51.471951 30213 heartbeater.cc:644] Failed to heartbeat to 127.4.26.126:43003 (0 consecutive failures): Network error: Failed to ping master at 127.4.26.126:43003: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
I20260812 11:13:51.472836 30219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:51.472469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:55493)
0812 11:13:51.472646 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:51.472721 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260812 11:13:51.473807 30219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:51.473401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:56527)
0812 11:13:51.473595 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:51.473688 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 11:13:51.474040 30213 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 11:13:51.476306 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 29993
I20260812 11:13:51.528652 30221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:51.527740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:59271)
0812 11:13:51.528299 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:51.528403 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":276,"threads_started":1}
I20260812 11:13:51.998757 30222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:51.997803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:34189)
0812 11:13:51.998349 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:51.998450 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":277,"threads_started":1}
I20260812 11:13:52.475622 30224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:52.474675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:37871)
0812 11:13:52.475189 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:52.475319 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":240,"threads_started":1}
I20260812 11:13:52.530535 30228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:52.529808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:42159)
0812 11:13:52.530281 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:52.530366 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":245,"threads_started":1}
I20260812 11:13:53.000640 30229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:52.999768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:39429)
0812 11:13:53.000338 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:53.000451 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":302,"threads_started":1}
I20260812 11:13:53.477566 30232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:53.476688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:48735)
0812 11:13:53.477241 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:53.477337 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":277,"threads_started":1}
I20260812 11:13:53.532580 30234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:53.531728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:50823)
0812 11:13:53.532284 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:53.532383 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":283,"threads_started":1}
I20260812 11:13:54.003005 30235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:54.001744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:59835)
0812 11:13:54.002686 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:54.002803 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":811,"thread_start_us":643,"threads_started":1}
I20260812 11:13:54.479343 30236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:54.478559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:41663)
0812 11:13:54.479067 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:54.479154 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":273,"threads_started":1}
I20260812 11:13:54.534456 30237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:54.533551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:32841)
0812 11:13:54.534198 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:54.534282 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":373,"threads_started":1}
I20260812 11:13:55.004858 30238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:55.004062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:53273)
0812 11:13:55.004563 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:55.004653 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":249,"threads_started":1}
I20260812 11:13:55.481487 30241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:55.480553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:45739)
0812 11:13:55.481062 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:55.481225 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":253,"threads_started":1}
I20260812 11:13:55.536342 30242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:55.535489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:52525)
0812 11:13:55.536050 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:55.536155 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":261,"threads_started":1}
I20260812 11:13:56.006803 30243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:56.005999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:45367)
0812 11:13:56.006508 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:56.006602 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":251,"threads_started":1}
I20260812 11:13:56.483703 30245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:56.482743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:43717)
0812 11:13:56.483377 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:56.483473 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":349,"threads_started":1}
I20260812 11:13:56.538062 30246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:56.537348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:59341)
0812 11:13:56.537810 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:56.537899 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":236,"threads_started":1}
I20260812 11:13:57.008832 30247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:57.007944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:43841)
0812 11:13:57.008469 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:57.008595 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":260,"threads_started":1}
I20260812 11:13:57.485620 30249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:57.484790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:50547)
0812 11:13:57.485321 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:57.485427 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":245,"threads_started":1}
I20260812 11:13:57.539930 30251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:57.539034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:53403)
0812 11:13:57.539602 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:57.539697 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":235,"threads_started":1}
I20260812 11:13:58.010931 30252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:58.010014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:54105)
0812 11:13:58.010565 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:58.010693 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":249,"threads_started":1}
I20260812 11:13:58.487677 30253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:58.486765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:48987)
0812 11:13:58.487336 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:58.487428 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":243,"threads_started":1}
I20260812 11:13:58.541643 30254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:58.540882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:43171)
0812 11:13:58.541385 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:58.541469 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":291,"threads_started":1}
I20260812 11:13:59.012714 30255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:59.011906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:36863)
0812 11:13:59.012404 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:59.012532 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":263,"threads_started":1}
I20260812 11:13:59.489646 30257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:59.488741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:50517)
0812 11:13:59.489338 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:59.489441 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":278,"threads_started":1}
I20260812 11:13:59.543501 30258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:13:59.542669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:40677)
0812 11:13:59.543204 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0812 11:13:59.543321 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":259,"threads_started":1}
I20260812 11:14:00.014740 30260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:00.013832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:46569)
0812 11:14:00.014415 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:00.014520 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":298,"threads_started":1}
I20260812 11:14:00.491518 30263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:00.490700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:48337)
0812 11:14:00.491238 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:00.491328 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":265,"threads_started":1}
I20260812 11:14:00.545392 30265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:00.544603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:34653)
0812 11:14:00.545077 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:00.545217 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":245,"threads_started":1}
I20260812 11:14:01.016700 30266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:01.015914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:38505)
0812 11:14:01.016425 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:01.016512 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":292,"threads_started":1}
I20260812 11:14:01.493328 30268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:01.492560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:51307)
0812 11:14:01.493026 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:01.493113 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":244,"threads_started":1}
I20260812 11:14:01.547375 30269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:01.546512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:51913)
0812 11:14:01.547091 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:01.547186 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":300,"threads_started":1}
I20260812 11:14:02.018599 30271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:02.017798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:36745)
0812 11:14:02.018297 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:02.018406 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":251,"threads_started":1}
I20260812 11:14:02.495105 30275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:02.494341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:55151)
0812 11:14:02.494826 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:02.494917 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":250,"threads_started":1}
I20260812 11:14:02.549412 30278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:02.548470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:40507)
0812 11:14:02.549081 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:02.549238 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":291,"threads_started":1}
I20260812 11:14:03.020385 30279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:03.019640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:59733)
0812 11:14:03.020133 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:03.020223 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":247,"threads_started":1}
I20260812 11:14:03.496793 30280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:03.496011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:58087)
0812 11:14:03.496521 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:03.496610 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":247,"threads_started":1}
I20260812 11:14:03.551622 30281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:03.550530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:36979)
0812 11:14:03.551182 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:03.551339 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":313,"threads_started":1}
I20260812 11:14:04.022224 30282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:04.021371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:55783)
0812 11:14:04.021899 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:04.022006 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":258,"threads_started":1}
I20260812 11:14:04.498626 30284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:04.497782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:59651)
0812 11:14:04.498317 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:04.498415 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":274,"threads_started":1}
I20260812 11:14:04.553603 30285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:04.552642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:33111)
0812 11:14:04.553216 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:04.553322 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":252,"threads_started":1}
I20260812 11:14:05.023890 30287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:05.023137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:36555)
0812 11:14:05.023608 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:05.023696 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":224,"threads_started":1}
I20260812 11:14:05.500500 30288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:05.499671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:50855)
0812 11:14:05.500191 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:05.500288 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":248,"threads_started":1}
I20260812 11:14:05.555823 30289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:05.554962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:33729)
0812 11:14:05.555516 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:05.555637 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":271,"threads_started":1}
I20260812 11:14:06.025918 30291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:06.025086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.66:49401)
0812 11:14:06.025581 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:06.025726 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":277,"threads_started":1}
I20260812 11:14:06.488756 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 29501
I20260812 11:14:06.502743 30296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:06.501733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.67:52079)
0812 11:14:06.502282 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:06.502418 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":270,"threads_started":1}
I20260812 11:14:06.508600 30292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:06.490417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40808 (local address 127.4.26.65:33835)
0812 11:14:06.491293 (+ 876us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:06.491315 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:06.491363 (+ 48us) server_negotiation.cc:407] Connection header received
0812 11:14:06.493185 (+ 1822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:06.493204 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:06.493672 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:06.494028 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:06.495611 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:06.496904 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:06.498267 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:06.498962 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:06.499169 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:06.502267 (+ 3098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:06.502280 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:06.502303 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:06.502351 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:06.505425 (+ 3074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:06.506155 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:06.506162 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:06.506169 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:06.506343 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:06.506692 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:06.506695 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:06.506697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:06.507274 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:06.507512 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:06.507906 (+ 394us) server_negotiation.cc:299] Negotiation successful
0812 11:14:06.508307 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":678,"thread_start_us":530,"threads_started":1}
I20260812 11:14:06.510039 29775 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:14:06.597332 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 29501
I20260812 11:14:06.597429 30298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:06.596290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:43003 (local address 127.4.26.65:40021)
0812 11:14:06.596884 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:06.597066 (+ 182us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:43003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":462,"threads_started":1}
I20260812 11:14:06.622527 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 29788
I20260812 11:14:06.641389 30304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:06.623506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47092 (local address 127.4.26.66:40569)
0812 11:14:06.624058 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:06.624073 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:06.624116 (+ 43us) server_negotiation.cc:407] Connection header received
0812 11:14:06.625656 (+ 1540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:06.625667 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:06.626125 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:06.626419 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:06.627835 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:06.629402 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:06.630773 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:06.631689 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:06.631835 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:06.634823 (+ 2988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:06.634832 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:06.634850 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:06.634895 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:06.638092 (+ 3197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:06.638831 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:06.638840 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:06.638847 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:06.639049 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:06.639382 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:06.639385 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:06.639387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:06.639976 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:06.640216 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:06.640656 (+ 440us) server_negotiation.cc:299] Negotiation successful
0812 11:14:06.641041 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":276,"threads_started":1}
I20260812 11:14:06.642968 29981 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:14:06.729115 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 29788
I20260812 11:14:06.752767 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 29993
I20260812 11:14:06.771622 30311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:06.753945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33678 (local address 127.4.26.67:44783)
0812 11:14:06.754604 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:06.754624 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:06.754670 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:14:06.756350 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:06.756362 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:06.756817 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:06.757126 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:06.758658 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:06.759927 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:06.761304 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:06.762050 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:06.762243 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:06.765066 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:06.765081 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:06.765132 (+ 51us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:06.765217 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:06.768355 (+ 3138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:06.769135 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:06.769142 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:06.769175 (+ 33us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:06.769374 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:06.769717 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:06.769720 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:06.769722 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:06.770334 (+ 612us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:06.770573 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:06.770921 (+ 348us) server_negotiation.cc:299] Negotiation successful
0812 11:14:06.771315 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":312,"threads_started":1}
I20260812 11:14:06.773183 30206 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:14:06.859237 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 29993
2026-08-12T11:14:06Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24902 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:14:06 dist-test-slave-rmhg krb5kdc[30317](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:14:06 dist-test-slave-rmhg krb5kdc[30317](info): set up 2 sockets
Aug 12 11:14:06 dist-test-slave-rmhg krb5kdc[30317](info): commencing operation
krb5kdc: starting...
W20260812 11:14:08.138971 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:14:08 dist-test-slave-rmhg krb5kdc[30317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:14:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:14:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:14:08.445587 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:41095
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:41095
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:14:08.802927 30339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:14:08.803288 30339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:14:08.803432 30339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:14:08.811146 30339 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 11:14:08.811290 30339 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 11:14:08.811352 30339 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 11:14:08.811424 30339 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:14:08.811502 30339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:14:08.811599 30339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:14:08.811662 30339 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:14:08.811749 30339 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:14:08.822188 30339 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:41095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:41095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:14:08.823643 30339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:14:08.825130 30339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:14:08.837767 30351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:08.837831 30348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:08.837854 30349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:14:08.838668 30339 server_base.cc:1034] running on GCE node
I20260812 11:14:08.839473 30339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:14:08.840941 30339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:14:08.842166 30339 hybrid_clock.cc:648] HybridClock initialized: now 1786533248842091 us; error 43 us; skew 500 ppm
I20260812 11:14:08.842510 30339 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:14:08 dist-test-slave-rmhg krb5kdc[30317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533248, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:14:08.845834 30339 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:14:08.847497 30339 webserver.cc:460] Webserver started at http://127.4.26.126:39593/ using document root <none> and password file <none>
I20260812 11:14:08.848393 30339 fs_manager.cc:359] Metadata directory not provided
I20260812 11:14:08.848510 30339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:14:08.848858 30339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:14:08.852213 30339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "f291c679cc8b45a183e067b310a9f4e1"
format_stamp: "Formatted at 2026-08-12 11:14:08 on dist-test-slave-rmhg"
server_key: "891f5c9054777c404ae7d5c9d25075f6"
server_key_iv: "bc14cd2c603b0a18b2295cbe8ce6388e"
server_key_version: "encryptionkey@0"
I20260812 11:14:08.853091 30339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "f291c679cc8b45a183e067b310a9f4e1"
format_stamp: "Formatted at 2026-08-12 11:14:08 on dist-test-slave-rmhg"
server_key: "891f5c9054777c404ae7d5c9d25075f6"
server_key_iv: "bc14cd2c603b0a18b2295cbe8ce6388e"
server_key_version: "encryptionkey@0"
I20260812 11:14:08.858805 30339 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 11:14:08.862685 30361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:08.864183 30339 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:14:08.864368 30339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "f291c679cc8b45a183e067b310a9f4e1"
format_stamp: "Formatted at 2026-08-12 11:14:08 on dist-test-slave-rmhg"
server_key: "891f5c9054777c404ae7d5c9d25075f6"
server_key_iv: "bc14cd2c603b0a18b2295cbe8ce6388e"
server_key_version: "encryptionkey@0"
I20260812 11:14:08.864610 30339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:14:08.892083 30339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:14:08.896664 30339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:14:08.896946 30339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:14:08.916124 30339 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:41095
I20260812 11:14:08.916144 30442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:41095 every 8 connection(s)
I20260812 11:14:08.917629 30339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:14:08.921651 30445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:14:08.926156 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 30339
I20260812 11:14:08.926407 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:14:08.927265 4201 external_mini_cluster.cc:1428] Setting key a33576ba7e5d566a60cdffe3f87a5fdc
I20260812 11:14:08.934168 30445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Bootstrap starting.
I20260812 11:14:08.938045 30445 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Neither blocks nor log segments found. Creating new log.
I20260812 11:14:08.939347 30445 log.cc:824] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Log is configured to *not* fsync() on all Append() calls
I20260812 11:14:08.942481 30445 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: No bootstrap required, opened a new log
Aug 12 11:14:08 dist-test-slave-rmhg krb5kdc[30317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:14:08.950600 30445 raft_consensus.cc:348] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } }
I20260812 11:14:08.951073 30445 raft_consensus.cc:374] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:14:08.951210 30445 raft_consensus.cc:729] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f291c679cc8b45a183e067b310a9f4e1, State: Initialized, Role: FOLLOWER
I20260812 11:14:08.951823 30445 consensus_queue.cc:260] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } }
I20260812 11:14:08.952069 30445 raft_consensus.cc:388] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:14:08.952119 30452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:08.929580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44654 (local address 127.4.26.126:41095)
0812 11:14:08.930406 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:08.930422 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:08.930476 (+ 54us) server_negotiation.cc:407] Connection header received
0812 11:14:08.932474 (+ 1998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:08.932503 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:08.932936 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:08.933337 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:08.935256 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:08.936734 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:08.938684 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:08.939453 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:08.939666 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:08.943882 (+ 4216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:08.943891 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:08.943909 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:08.943963 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:08.947347 (+ 3384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:08.948189 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:08.948201 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:08.948209 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:08.948419 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:08.948852 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:08.948860 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:08.948862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:08.949553 (+ 691us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:08.949883 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:08.950358 (+ 475us) server_negotiation.cc:299] Negotiation successful
0812 11:14:08.950829 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":377,"threads_started":1}
I20260812 11:14:08.952231 30445 raft_consensus.cc:482] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:14:08.952421 30445 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:14:08.955231 30445 raft_consensus.cc:504] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } }
I20260812 11:14:08.955790 30445 leader_election.cc:302] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f291c679cc8b45a183e067b310a9f4e1; no voters:
I20260812 11:14:08.956378 30445 leader_election.cc:288] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:14:08.956526 30455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:14:08.957716 30455 raft_consensus.cc:686] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 1 LEADER]: Becoming Leader. State: Replica: f291c679cc8b45a183e067b310a9f4e1, State: Running, Role: LEADER
I20260812 11:14:08.958350 30455 consensus_queue.cc:237] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } }
I20260812 11:14:08.958640 30445 sys_catalog.cc:564] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:14:08.961401 30456 sys_catalog.cc:455] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f291c679cc8b45a183e067b310a9f4e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } } }
I20260812 11:14:08.961748 30456 sys_catalog.cc:458] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [sys.catalog]: This master's current role is: LEADER
I20260812 11:14:08.962102 30457 sys_catalog.cc:455] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f291c679cc8b45a183e067b310a9f4e1. Latest consensus state: current_term: 1 leader_uuid: "f291c679cc8b45a183e067b310a9f4e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } } }
I20260812 11:14:08.962432 30457 sys_catalog.cc:458] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [sys.catalog]: This master's current role is: LEADER
I20260812 11:14:08.962604 30463 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:14:08.968014 30463 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:14:08.978128 30463 catalog_manager.cc:1347] Generated new cluster ID: 11df7e28e2384cad983e059acf0233dc
I20260812 11:14:08.978269 30463 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:14:08.991380 30463 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:14:08.992830 30463 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:14:09.003945 30463 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Generated new TSK 0
I20260812 11:14:09.005296 30463 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:14:09.070820 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:41095
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:14:09.420639 30488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:14:09.420936 30488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:14:09.421041 30488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:14:09.428417 30488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:14:09.428544 30488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:14:09.428702 30488 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:14:09.438851 30488 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:41095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:14:09.440233 30488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:14:09.441713 30488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:14:09.455093 30500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:09.455005 30497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:09.455565 30495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:14:09.456354 30488 server_base.cc:1034] running on GCE node
I20260812 11:14:09.456974 30488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:14:09.458002 30488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:14:09.459225 30488 hybrid_clock.cc:648] HybridClock initialized: now 1786533249459162 us; error 59 us; skew 500 ppm
I20260812 11:14:09.459561 30488 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:14:09 dist-test-slave-rmhg krb5kdc[30317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533249, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:14:09.462994 30488 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:14:09.464710 30488 webserver.cc:460] Webserver started at http://127.4.26.65:41429/ using document root <none> and password file <none>
I20260812 11:14:09.465504 30488 fs_manager.cc:359] Metadata directory not provided
I20260812 11:14:09.465618 30488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:14:09.465902 30488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:14:09.469120 30488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "df151cb0ae45474cba93241cb45a3b3a"
format_stamp: "Formatted at 2026-08-12 11:14:09 on dist-test-slave-rmhg"
server_key: "364e09347ec0e7f05657b637d2e65914"
server_key_iv: "7a8a71c098543db4aa54dac4f82e1fcc"
server_key_version: "encryptionkey@0"
I20260812 11:14:09.470026 30488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "df151cb0ae45474cba93241cb45a3b3a"
format_stamp: "Formatted at 2026-08-12 11:14:09 on dist-test-slave-rmhg"
server_key: "364e09347ec0e7f05657b637d2e65914"
server_key_iv: "7a8a71c098543db4aa54dac4f82e1fcc"
server_key_version: "encryptionkey@0"
I20260812 11:14:09.475852 30488 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260812 11:14:09.479794 30514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:09.481419 30488 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 11:14:09.481612 30488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "df151cb0ae45474cba93241cb45a3b3a"
format_stamp: "Formatted at 2026-08-12 11:14:09 on dist-test-slave-rmhg"
server_key: "364e09347ec0e7f05657b637d2e65914"
server_key_iv: "7a8a71c098543db4aa54dac4f82e1fcc"
server_key_version: "encryptionkey@0"
I20260812 11:14:09.481837 30488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:14:09.495263 30488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:14:09.499406 30488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:14:09.499702 30488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:14:09.500684 30488 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:14:09.502130 30488 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:14:09.502208 30488 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:09.502314 30488 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:14:09.502370 30488 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:09.533217 30488 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:33263
I20260812 11:14:09.533279 30713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:33263 every 8 connection(s)
I20260812 11:14:09.534524 30488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:14:09.541015 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 30488
I20260812 11:14:09.541239 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:14:09.541908 4201 external_mini_cluster.cc:1428] Setting key 1c64231e54eacdda7c7d9c1df8cc733e
Aug 12 11:14:09 dist-test-slave-rmhg krb5kdc[30317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533249, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:14:09.556551 30718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:09.537125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:37841 (local address 127.4.26.126:41095)
0812 11:14:09.537594 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:09.537599 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:09.538456 (+ 857us) server_negotiation.cc:407] Connection header received
0812 11:14:09.540394 (+ 1938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:09.540400 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:09.540504 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:09.540627 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:09.542393 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:09.543276 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:09.545230 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:09.545809 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:09.545937 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:09.549709 (+ 3772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:09.549717 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:09.549722 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:09.549767 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:09.552983 (+ 3216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:09.553946 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:09.553952 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:09.553956 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:09.554127 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:09.554651 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:09.554656 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:09.554659 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:09.555004 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:09.555164 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:09.555933 (+ 769us) server_negotiation.cc:299] Negotiation successful
0812 11:14:09.556193 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":214,"threads_started":1}
I20260812 11:14:09.557731 30719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:09.537560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:37841)
0812 11:14:09.538285 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:09.538325 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:14:09.540081 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:14:09.540880 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:14:09.540889 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:14:09.541539 (+ 650us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:14:09.542194 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:09.542217 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:09.543467 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:09.543473 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:09.545037 (+ 1564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:09.545052 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:09.546049 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:09.546055 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:09.546303 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:09.547025 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:14:09.547051 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:14:09.549430 (+ 2379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:14:09.553234 (+ 3804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:14:09.553243 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:14:09.553259 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:14:09.553782 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:14:09.554276 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:14:09.554280 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:14:09.554282 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:14:09.554531 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:14:09.555130 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:14:09.555136 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:14:09.555516 (+ 380us) client_negotiation.cc:769] Sending connection context
0812 11:14:09.555764 (+ 248us) client_negotiation.cc:240] Negotiation successful
0812 11:14:09.556249 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":275,"threads_started":1}
I20260812 11:14:09.559456 30715 heartbeater.cc:347] Connected to a master server at 127.4.26.126:41095
I20260812 11:14:09.559793 30715 heartbeater.cc:464] Registering TS with master...
I20260812 11:14:09.560598 30715 heartbeater.cc:511] Master 127.4.26.126:41095 requested a full tablet report, sending...
I20260812 11:14:09.562867 30384 ts_manager.cc:194] Registered new tserver with Master: df151cb0ae45474cba93241cb45a3b3a (127.4.26.65:33263)
I20260812 11:14:09.564465 30384 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:37841
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:14:09.608711 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:41095
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:14:09.955821 30724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:14:09.956183 30724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:14:09.956314 30724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:14:09.963913 30724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:14:09.964084 30724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:14:09.964250 30724 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:14:09.974857 30724 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:41095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:14:09.976310 30724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:14:09.978046 30724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:14:09.992533 30731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:09.992694 30735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:09.992599 30733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:14:09.993432 30724 server_base.cc:1034] running on GCE node
I20260812 11:14:09.994123 30724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:14:09.995163 30724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:14:09.996388 30724 hybrid_clock.cc:648] HybridClock initialized: now 1786533249996335 us; error 47 us; skew 500 ppm
I20260812 11:14:09.996755 30724 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:14:09 dist-test-slave-rmhg krb5kdc[30317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533249, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:14:10.000102 30724 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:14:10.001881 30724 webserver.cc:460] Webserver started at http://127.4.26.66:41257/ using document root <none> and password file <none>
I20260812 11:14:10.002651 30724 fs_manager.cc:359] Metadata directory not provided
I20260812 11:14:10.002780 30724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:14:10.003125 30724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:14:10.006562 30724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "8adaa307ca4f484ab8576f4e87b3871b"
format_stamp: "Formatted at 2026-08-12 11:14:09 on dist-test-slave-rmhg"
server_key: "d19ae44fa5d5cc86b551b0ac135005b3"
server_key_iv: "89f375c30340832abe7968d9b165159e"
server_key_version: "encryptionkey@0"
I20260812 11:14:10.007489 30724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "8adaa307ca4f484ab8576f4e87b3871b"
format_stamp: "Formatted at 2026-08-12 11:14:09 on dist-test-slave-rmhg"
server_key: "d19ae44fa5d5cc86b551b0ac135005b3"
server_key_iv: "89f375c30340832abe7968d9b165159e"
server_key_version: "encryptionkey@0"
I20260812 11:14:10.013619 30724 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260812 11:14:10.017932 30748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:10.019557 30724 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:14:10.019754 30724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "8adaa307ca4f484ab8576f4e87b3871b"
format_stamp: "Formatted at 2026-08-12 11:14:09 on dist-test-slave-rmhg"
server_key: "d19ae44fa5d5cc86b551b0ac135005b3"
server_key_iv: "89f375c30340832abe7968d9b165159e"
server_key_version: "encryptionkey@0"
I20260812 11:14:10.019965 30724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:14:10.065423 30724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:14:10.070165 30724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:14:10.070456 30724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:14:10.071538 30724 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:14:10.073117 30724 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:14:10.073235 30724 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260812 11:14:10.073367 30724 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:14:10.073427 30724 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:10.106429 30724 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:43463
I20260812 11:14:10.106479 30949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:43463 every 8 connection(s)
I20260812 11:14:10.107802 30724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:14:10.109280 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 30724
I20260812 11:14:10.109465 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:14:10.109918 4201 external_mini_cluster.cc:1428] Setting key fbb0ce658fffe6ac9f7b9a86397a2f99
Aug 12 11:14:10 dist-test-slave-rmhg krb5kdc[30317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533249, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:14:10.132324 30955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:10.111231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:50139)
0812 11:14:10.112159 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:10.112218 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 11:14:10.114157 (+ 1939us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:14:10.115015 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:14:10.115024 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:14:10.115618 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:14:10.116272 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:10.116294 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.117478 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.117482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:10.118858 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:10.118874 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.119766 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.119775 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:10.120038 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:10.120869 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:14:10.120905 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:14:10.123671 (+ 2766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:14:10.127434 (+ 3763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:14:10.127444 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:14:10.127462 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:14:10.127999 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:14:10.128469 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:14:10.128473 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:14:10.128476 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:14:10.128721 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:14:10.129379 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:14:10.129388 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:14:10.129919 (+ 531us) client_negotiation.cc:769] Sending connection context
0812 11:14:10.130244 (+ 325us) client_negotiation.cc:240] Negotiation successful
0812 11:14:10.130893 (+ 649us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":392,"threads_started":1}
I20260812 11:14:10.133489 30952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:10.110609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:50139 (local address 127.4.26.126:41095)
0812 11:14:10.111038 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:10.111042 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:10.112350 (+ 1308us) server_negotiation.cc:407] Connection header received
0812 11:14:10.114501 (+ 2151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:10.114507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:10.114600 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:10.114714 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:10.116492 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.117305 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.119052 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.119508 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.119633 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:10.124128 (+ 4495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:10.124135 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:10.124138 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:10.124184 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:10.127228 (+ 3044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:10.128161 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:10.128166 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:10.128169 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:10.128328 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:10.128852 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:10.128857 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:10.128859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:10.129228 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:10.129378 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:10.132949 (+ 3571us) server_negotiation.cc:299] Negotiation successful
0812 11:14:10.133204 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":436,"threads_started":1}
I20260812 11:14:10.134955 30950 heartbeater.cc:347] Connected to a master server at 127.4.26.126:41095
I20260812 11:14:10.135370 30950 heartbeater.cc:464] Registering TS with master...
I20260812 11:14:10.136332 30950 heartbeater.cc:511] Master 127.4.26.126:41095 requested a full tablet report, sending...
I20260812 11:14:10.138185 30384 ts_manager.cc:194] Registered new tserver with Master: 8adaa307ca4f484ab8576f4e87b3871b (127.4.26.66:43463)
I20260812 11:14:10.139103 30384 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:50139
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:14:10.176599 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:41095
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:14:10.533818 30960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:14:10.534129 30960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:14:10.534253 30960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:14:10.541985 30960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:14:10.542115 30960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:14:10.542258 30960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:14:10.552416 30960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:41095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:14:10.553851 30960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:14:10.555212 30960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 11:14:10.567807 30715 heartbeater.cc:503] Master 127.4.26.126:41095 was elected leader, sending a full tablet report...
W20260812 11:14:10.568682 30966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:10.568742 30967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:10.568761 30971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:14:10.570837 30960 server_base.cc:1034] running on GCE node
I20260812 11:14:10.571539 30960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:14:10.572582 30960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:14:10.573808 30960 hybrid_clock.cc:648] HybridClock initialized: now 1786533250573746 us; error 42 us; skew 500 ppm
I20260812 11:14:10.574187 30960 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:14:10 dist-test-slave-rmhg krb5kdc[30317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533250, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:14:10.577641 30960 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:14:10.579377 30960 webserver.cc:460] Webserver started at http://127.4.26.67:42837/ using document root <none> and password file <none>
I20260812 11:14:10.580109 30960 fs_manager.cc:359] Metadata directory not provided
I20260812 11:14:10.580222 30960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:14:10.580515 30960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:14:10.583763 30960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2"
format_stamp: "Formatted at 2026-08-12 11:14:10 on dist-test-slave-rmhg"
server_key: "7f348fa14ace5be61e0c5ccb88e93e63"
server_key_iv: "71115408bd0a805b8afdb9314ad543d3"
server_key_version: "encryptionkey@0"
I20260812 11:14:10.584652 30960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2"
format_stamp: "Formatted at 2026-08-12 11:14:10 on dist-test-slave-rmhg"
server_key: "7f348fa14ace5be61e0c5ccb88e93e63"
server_key_iv: "71115408bd0a805b8afdb9314ad543d3"
server_key_version: "encryptionkey@0"
I20260812 11:14:10.591321 30960 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260812 11:14:10.595549 30982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:10.597342 30960 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:14:10.597550 30960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2"
format_stamp: "Formatted at 2026-08-12 11:14:10 on dist-test-slave-rmhg"
server_key: "7f348fa14ace5be61e0c5ccb88e93e63"
server_key_iv: "71115408bd0a805b8afdb9314ad543d3"
server_key_version: "encryptionkey@0"
I20260812 11:14:10.597774 30960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:14:10.631345 30960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:14:10.635896 30960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:14:10.636197 30960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:14:10.637300 30960 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:14:10.638712 30960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:14:10.638794 30960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:10.638908 30960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:14:10.638959 30960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:10.672345 30960 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:40831
I20260812 11:14:10.672399 31182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:40831 every 8 connection(s)
I20260812 11:14:10.673725 30960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:14:10.677939 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 30960
I20260812 11:14:10.678158 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:14:10.678779 4201 external_mini_cluster.cc:1428] Setting key 551ea58b60e471cc342676e1a2c31449
Aug 12 11:14:10 dist-test-slave-rmhg krb5kdc[30317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533250, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:14:10.696137 31188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:10.676433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:58043 (local address 127.4.26.126:41095)
0812 11:14:10.676936 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:10.676941 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:10.678266 (+ 1325us) server_negotiation.cc:407] Connection header received
0812 11:14:10.680710 (+ 2444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:10.680715 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:10.680798 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:10.680924 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:10.682838 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.683668 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.685423 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.685866 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.685985 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:10.689693 (+ 3708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:10.689699 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:10.689702 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:10.689741 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:10.692494 (+ 2753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:10.693381 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:10.693386 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:10.693388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:10.693567 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:10.694050 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:10.694054 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:10.694056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:10.694440 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:10.694598 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:10.695453 (+ 855us) server_negotiation.cc:299] Negotiation successful
0812 11:14:10.695694 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":252,"threads_started":1}
I20260812 11:14:10.697193 31190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:10.677032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:58043)
0812 11:14:10.678005 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:10.678066 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0812 11:14:10.680378 (+ 2312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:14:10.681248 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:14:10.681261 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:14:10.681907 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:14:10.682677 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:10.682697 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.683820 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.683824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:10.685261 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:10.685276 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.686111 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.686117 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:10.686346 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:10.687055 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:14:10.687081 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:14:10.689429 (+ 2348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:14:10.692673 (+ 3244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:14:10.692685 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:14:10.692702 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:14:10.693241 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:14:10.693692 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:14:10.693696 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:14:10.693698 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:14:10.693913 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:14:10.694580 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:14:10.694613 (+ 33us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:14:10.695058 (+ 445us) client_negotiation.cc:769] Sending connection context
0812 11:14:10.695333 (+ 275us) client_negotiation.cc:240] Negotiation successful
0812 11:14:10.695940 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":370,"threads_started":1}
I20260812 11:14:10.698604 31183 heartbeater.cc:347] Connected to a master server at 127.4.26.126:41095
I20260812 11:14:10.698921 31183 heartbeater.cc:464] Registering TS with master...
I20260812 11:14:10.699715 31183 heartbeater.cc:511] Master 127.4.26.126:41095 requested a full tablet report, sending...
I20260812 11:14:10.701388 30384 ts_manager.cc:194] Registered new tserver with Master: 4a8cdf8b2dc3466a982a271a3b6f12f2 (127.4.26.67:40831)
I20260812 11:14:10.702312 30384 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:58043
I20260812 11:14:10.707834 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:14:10.726300 31188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:10.712851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38924 (local address 127.4.26.126:41095)
0812 11:14:10.713018 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:10.713031 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:10.713460 (+ 429us) server_negotiation.cc:407] Connection header received
0812 11:14:10.713611 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:10.713617 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:10.713714 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:10.713811 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:10.715439 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.716243 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.717937 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.718416 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.718537 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:10.721072 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:10.721079 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:10.721083 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:10.721124 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:10.723846 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:10.724473 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:10.724477 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:10.724479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:10.724609 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:10.724942 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:10.724946 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:10.724949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:10.725364 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:10.725557 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:10.725834 (+ 277us) server_negotiation.cc:299] Negotiation successful
0812 11:14:10.726028 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:14:10.730955 30384 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:14:10.738390 30384 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:14:10.773696 31207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:10.752062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34848 (local address 127.4.26.67:40831)
0812 11:14:10.763924 (+ 11862us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:10.763935 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:10.763977 (+ 42us) server_negotiation.cc:407] Connection header received
0812 11:14:10.764102 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:10.764110 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:10.764418 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:10.764665 (+ 247us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:14:10.765798 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.767658 (+ 1860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.770819 (+ 3161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.772364 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.772514 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:10.772784 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:10.773140 (+ 356us) server_negotiation.cc:299] Negotiation successful
0812 11:14:10.773347 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11683,"thread_start_us":11493,"threads_started":1}
I20260812 11:14:10.773783 31212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:10.751733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:40831 (local address 127.0.0.1:34848)
0812 11:14:10.761017 (+ 9284us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:10.761080 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 11:14:10.762404 (+ 1324us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:14:10.764712 (+ 2308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:14:10.764720 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:14:10.764751 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:14:10.765553 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:10.765569 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.767843 (+ 2274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.767848 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:10.770642 (+ 2794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:10.770655 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.772592 (+ 1937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.772599 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:10.772830 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:10.772901 (+ 71us) client_negotiation.cc:769] Sending connection context
0812 11:14:10.773048 (+ 147us) client_negotiation.cc:240] Negotiation successful
0812 11:14:10.773261 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8905,"mutex_wait_us":164,"thread_start_us":12636,"threads_started":1}
I20260812 11:14:10.774482 31213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:10.753739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47808 (local address 127.4.26.66:43463)
0812 11:14:10.763680 (+ 9941us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:10.763691 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:10.764965 (+ 1274us) server_negotiation.cc:407] Connection header received
0812 11:14:10.765076 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:10.765083 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:10.765309 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:10.765485 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:14:10.766539 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.767592 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.771505 (+ 3913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.772476 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.772618 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:10.772815 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:10.773567 (+ 752us) server_negotiation.cc:299] Negotiation successful
0812 11:14:10.773746 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9756,"thread_start_us":9720,"threads_started":1}
I20260812 11:14:10.774526 31211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:10.752785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35686 (local address 127.4.26.65:33263)
0812 11:14:10.764370 (+ 11585us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:10.764379 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:10.764410 (+ 31us) server_negotiation.cc:407] Connection header received
0812 11:14:10.764525 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:10.764532 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:10.764775 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:10.765065 (+ 290us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:14:10.766260 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.767806 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.770958 (+ 3152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.772494 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.773684 (+ 1190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:10.773931 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:10.774024 (+ 93us) server_negotiation.cc:299] Negotiation successful
0812 11:14:10.774200 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11396,"thread_start_us":11222,"threads_started":1}
I20260812 11:14:10.774905 31205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:10.752068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33263 (local address 127.0.0.1:35686)
0812 11:14:10.763183 (+ 11115us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:10.763209 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:14:10.763335 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:14:10.765066 (+ 1731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:14:10.765070 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:14:10.765100 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:14:10.765963 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:10.765976 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.768011 (+ 2035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.768016 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:10.770795 (+ 2779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:10.770810 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.772740 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.772749 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:10.772914 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:10.772940 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:14:10.773009 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 11:14:10.773250 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10985,"mutex_wait_us":33,"thread_start_us":11631,"threads_started":1}
I20260812 11:14:10.775192 31204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:10.753542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:43463 (local address 127.0.0.1:47808)
0812 11:14:10.764672 (+ 11130us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:10.764697 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0812 11:14:10.764824 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:14:10.765785 (+ 961us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:14:10.765789 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:14:10.765816 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:14:10.766348 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:10.766361 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.767739 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.767744 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:10.771331 (+ 3587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:10.771342 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.772967 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.772973 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:10.773132 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:10.773206 (+ 74us) client_negotiation.cc:769] Sending connection context
0812 11:14:10.773282 (+ 76us) client_negotiation.cc:240] Negotiation successful
0812 11:14:10.773402 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11005,"mutex_wait_us":218,"thread_start_us":6897,"threads_started":1}
I20260812 11:14:10.778491 30835 tablet_service.cc:1467] Processing CreateTablet for tablet aa57d2dbe8a941c591abafe2f7c54e31 (DEFAULT_TABLE table=test-table [id=e871c5dd3a014debab73086aaa240ba7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:14:10.778537 31072 tablet_service.cc:1467] Processing CreateTablet for tablet aa57d2dbe8a941c591abafe2f7c54e31 (DEFAULT_TABLE table=test-table [id=e871c5dd3a014debab73086aaa240ba7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:14:10.778739 30604 tablet_service.cc:1467] Processing CreateTablet for tablet aa57d2dbe8a941c591abafe2f7c54e31 (DEFAULT_TABLE table=test-table [id=e871c5dd3a014debab73086aaa240ba7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:14:10.779923 30835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa57d2dbe8a941c591abafe2f7c54e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:14:10.780131 31072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa57d2dbe8a941c591abafe2f7c54e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:14:10.780125 30604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa57d2dbe8a941c591abafe2f7c54e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:14:10.793318 31215 tablet_bootstrap.cc:492] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b: Bootstrap starting.
I20260812 11:14:10.796748 31215 tablet_bootstrap.cc:654] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b: Neither blocks nor log segments found. Creating new log.
I20260812 11:14:10.797937 31215 log.cc:824] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b: Log is configured to *not* fsync() on all Append() calls
I20260812 11:14:10.800770 31217 tablet_bootstrap.cc:492] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: Bootstrap starting.
I20260812 11:14:10.801409 31218 tablet_bootstrap.cc:492] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2: Bootstrap starting.
I20260812 11:14:10.803825 31215 tablet_bootstrap.cc:492] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b: No bootstrap required, opened a new log
I20260812 11:14:10.804132 31215 ts_tablet_manager.cc:1397] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260812 11:14:10.805490 31217 tablet_bootstrap.cc:654] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: Neither blocks nor log segments found. Creating new log.
I20260812 11:14:10.805491 31218 tablet_bootstrap.cc:654] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2: Neither blocks nor log segments found. Creating new log.
I20260812 11:14:10.806931 31217 log.cc:824] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:14:10.806948 31218 log.cc:824] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2: Log is configured to *not* fsync() on all Append() calls
I20260812 11:14:10.812665 31215 raft_consensus.cc:348] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:10.813225 31215 raft_consensus.cc:374] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:14:10.813366 31215 raft_consensus.cc:729] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8adaa307ca4f484ab8576f4e87b3871b, State: Initialized, Role: FOLLOWER
I20260812 11:14:10.814399 31215 consensus_queue.cc:260] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:10.815707 30950 heartbeater.cc:503] Master 127.4.26.126:41095 was elected leader, sending a full tablet report...
I20260812 11:14:10.816480 31215 ts_tablet_manager.cc:1428] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260812 11:14:10.816969 31217 tablet_bootstrap.cc:492] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: No bootstrap required, opened a new log
I20260812 11:14:10.817101 31218 tablet_bootstrap.cc:492] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2: No bootstrap required, opened a new log
I20260812 11:14:10.817354 31217 ts_tablet_manager.cc:1397] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.004s
I20260812 11:14:10.817416 31218 ts_tablet_manager.cc:1397] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.005s
I20260812 11:14:10.826633 31217 raft_consensus.cc:348] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:10.826639 31218 raft_consensus.cc:348] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:10.827062 31217 raft_consensus.cc:374] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:14:10.827070 31218 raft_consensus.cc:374] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:14:10.827173 31218 raft_consensus.cc:729] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a8cdf8b2dc3466a982a271a3b6f12f2, State: Initialized, Role: FOLLOWER
I20260812 11:14:10.827170 31217 raft_consensus.cc:729] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df151cb0ae45474cba93241cb45a3b3a, State: Initialized, Role: FOLLOWER
I20260812 11:14:10.827790 31217 consensus_queue.cc:260] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:10.827807 31218 consensus_queue.cc:260] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:10.829094 31183 heartbeater.cc:503] Master 127.4.26.126:41095 was elected leader, sending a full tablet report...
I20260812 11:14:10.829732 31218 ts_tablet_manager.cc:1428] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2: Time spent starting tablet: real 0.012s user 0.010s sys 0.002s
I20260812 11:14:10.830245 31217 ts_tablet_manager.cc:1428] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
W20260812 11:14:10.859968 30951 tablet.cc:2369] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:14:10.925407 31186 tablet.cc:2369] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:14:10.957581 31227 raft_consensus.cc:482] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:14:10.957930 31227 raft_consensus.cc:504] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:10.959923 31227 leader_election.cc:288] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df151cb0ae45474cba93241cb45a3b3a (127.4.26.65:33263), 8adaa307ca4f484ab8576f4e87b3871b (127.4.26.66:43463)
I20260812 11:14:10.966683 31213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:10.960541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:55631 (local address 127.4.26.66:43463)
0812 11:14:10.960762 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:10.960767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:10.960791 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:14:10.960874 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:10.960879 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:10.960959 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:10.961060 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:14:10.961517 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.962485 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.964686 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.965763 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.965903 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:10.966004 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:10.966283 (+ 279us) server_negotiation.cc:299] Negotiation successful
0812 11:14:10.966417 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 11:14:10.966701 31190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:10.960209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:43463 (local address 127.4.26.67:55631)
0812 11:14:10.960452 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:10.960473 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:14:10.960630 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:14:10.961103 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:14:10.961108 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:14:10.961170 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:14:10.961372 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:10.961384 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.962630 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.962634 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:10.964501 (+ 1867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:10.964517 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.965955 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.965960 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:10.966120 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:10.966146 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:14:10.966238 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 11:14:10.966341 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"mutex_wait_us":1}
I20260812 11:14:10.967296 31211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:10.960353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:51053 (local address 127.4.26.65:33263)
0812 11:14:10.960562 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:10.960568 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:10.961221 (+ 653us) server_negotiation.cc:407] Connection header received
0812 11:14:10.961483 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:10.961489 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:10.961567 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:10.961661 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:14:10.962260 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.963077 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.965246 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.966373 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.966510 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:10.966608 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:10.967012 (+ 404us) server_negotiation.cc:299] Negotiation successful
0812 11:14:10.967126 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 11:14:10.967684 30867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa57d2dbe8a941c591abafe2f7c54e31" candidate_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8adaa307ca4f484ab8576f4e87b3871b" is_pre_election: true
I20260812 11:14:10.967869 31230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:10.960212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33263 (local address 127.4.26.67:51053)
0812 11:14:10.961100 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:10.961118 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:14:10.961323 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:14:10.961696 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:14:10.961700 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:14:10.961723 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:14:10.962100 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:10.962114 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.963241 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.963247 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:10.965063 (+ 1816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:10.965075 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:10.966614 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:10.966619 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:10.966810 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:10.966843 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 11:14:10.967467 (+ 624us) client_negotiation.cc:240] Negotiation successful
0812 11:14:10.967598 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":755,"mutex_wait_us":168,"thread_start_us":362,"threads_started":1}
I20260812 11:14:10.968215 30867 raft_consensus.cc:2454] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a8cdf8b2dc3466a982a271a3b6f12f2 in term 0.
I20260812 11:14:10.968910 30985 leader_election.cc:302] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8cdf8b2dc3466a982a271a3b6f12f2, 8adaa307ca4f484ab8576f4e87b3871b; no voters:
I20260812 11:14:10.968925 30636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa57d2dbe8a941c591abafe2f7c54e31" candidate_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df151cb0ae45474cba93241cb45a3b3a" is_pre_election: true
I20260812 11:14:10.969367 31227 raft_consensus.cc:2781] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:14:10.969542 31227 raft_consensus.cc:482] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:14:10.969496 30636 raft_consensus.cc:2454] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a8cdf8b2dc3466a982a271a3b6f12f2 in term 0.
I20260812 11:14:10.969697 31227 raft_consensus.cc:3037] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:14:10.972025 31227 raft_consensus.cc:504] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:10.972642 31227 leader_election.cc:288] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [CANDIDATE]: Term 1 election: Requested vote from peers df151cb0ae45474cba93241cb45a3b3a (127.4.26.65:33263), 8adaa307ca4f484ab8576f4e87b3871b (127.4.26.66:43463)
I20260812 11:14:10.973191 30636 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa57d2dbe8a941c591abafe2f7c54e31" candidate_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df151cb0ae45474cba93241cb45a3b3a"
I20260812 11:14:10.973191 30867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa57d2dbe8a941c591abafe2f7c54e31" candidate_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8adaa307ca4f484ab8576f4e87b3871b"
I20260812 11:14:10.973412 30636 raft_consensus.cc:3037] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:14:10.973412 30867 raft_consensus.cc:3037] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:14:10.976681 30636 raft_consensus.cc:2454] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8cdf8b2dc3466a982a271a3b6f12f2 in term 1.
I20260812 11:14:10.976681 30867 raft_consensus.cc:2454] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8cdf8b2dc3466a982a271a3b6f12f2 in term 1.
I20260812 11:14:10.977285 30985 leader_election.cc:302] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4a8cdf8b2dc3466a982a271a3b6f12f2, 8adaa307ca4f484ab8576f4e87b3871b, df151cb0ae45474cba93241cb45a3b3a; no voters:
I20260812 11:14:10.977643 31227 raft_consensus.cc:2781] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:14:10.978135 31227 raft_consensus.cc:686] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 1 LEADER]: Becoming Leader. State: Replica: 4a8cdf8b2dc3466a982a271a3b6f12f2, State: Running, Role: LEADER
I20260812 11:14:10.978634 31227 consensus_queue.cc:237] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:10.983904 30383 catalog_manager.cc:5495] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a8cdf8b2dc3466a982a271a3b6f12f2 (127.4.26.67). New cstate: current_term: 1 leader_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } health_report { overall_health: UNKNOWN } } }
I20260812 11:14:11.022364 31207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:11.016752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34864 (local address 127.4.26.67:40831)
0812 11:14:11.016992 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:11.016998 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:11.017031 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:14:11.017195 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:11.017201 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:11.017297 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:11.017437 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:14:11.017848 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:11.018606 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:11.020094 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:11.020502 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:11.020615 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:11.021188 (+ 573us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:14:11.021757 (+ 569us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:14:11.021907 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:11.021999 (+ 92us) server_negotiation.cc:299] Negotiation successful
0812 11:14:11.022097 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260812 11:14:11.031320 30636 raft_consensus.cc:1261] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a [term 1 FOLLOWER]: Refusing update from remote peer 4a8cdf8b2dc3466a982a271a3b6f12f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:14:11.031374 30867 raft_consensus.cc:1261] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b [term 1 FOLLOWER]: Refusing update from remote peer 4a8cdf8b2dc3466a982a271a3b6f12f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:14:11.032339 31231 consensus_queue.cc:1035] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:14:11.032735 31227 consensus_queue.cc:1035] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:14:11.037050 30716 tablet.cc:2369] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:14:11.043040 31239 mvcc.cc:205] Tried to move back new op lower bound from 7317640196212805632 to 7317640196012433408. Current Snapshot: MvccSnapshot[applied={T|T < 7317640196212805632}]
I20260812 11:14:11.053314 31243 mvcc.cc:205] Tried to move back new op lower bound from 7317640196212805632 to 7317640196012433408. Current Snapshot: MvccSnapshot[applied={T|T < 7317640196212805632}]
I20260812 11:14:11.057430 30383 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:14:11.057886 30383 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:14:11.062441 30383 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Sending DeleteTablet for 3 replicas of tablet aa57d2dbe8a941c591abafe2f7c54e31
I20260812 11:14:11.063943 31072 tablet_service.cc:1514] Processing DeleteTablet for tablet aa57d2dbe8a941c591abafe2f7c54e31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:14:11 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:34848
I20260812 11:14:11.064116 30835 tablet_service.cc:1514] Processing DeleteTablet for tablet aa57d2dbe8a941c591abafe2f7c54e31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:14:11 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:47808
I20260812 11:14:11.064905 31256 tablet_replica.cc:330] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2: stopping tablet replica
I20260812 11:14:11.065194 30604 tablet_service.cc:1514] Processing DeleteTablet for tablet aa57d2dbe8a941c591abafe2f7c54e31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:14:11 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:35686
I20260812 11:14:11.065371 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 30488
I20260812 11:14:11.065611 31256 raft_consensus.cc:2229] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:14:11.066324 31256 raft_consensus.cc:2258] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:14:11.068859 31256 ts_tablet_manager.cc:1905] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:14:11.075939 31260 tablet_replica.cc:330] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b: stopping tablet replica
I20260812 11:14:11.076376 31260 raft_consensus.cc:2229] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:14:11.076977 31260 raft_consensus.cc:2258] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:14:11.079074 31256 ts_tablet_manager.cc:1918] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
Aug 12 11:14:11 dist-test-slave-rmhg krb5kdc[30317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:14:11.079291 31256 log.cc:1196] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/aa57d2dbe8a941c591abafe2f7c54e31
I20260812 11:14:11.079882 31256 ts_tablet_manager.cc:1939] T aa57d2dbe8a941c591abafe2f7c54e31 P 4a8cdf8b2dc3466a982a271a3b6f12f2: Deleting consensus metadata
I20260812 11:14:11.081885 31263 tablet_replica.cc:330] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: stopping tablet replica
I20260812 11:14:11.082173 30368 catalog_manager.cc:4841] TS 4a8cdf8b2dc3466a982a271a3b6f12f2 (127.4.26.67:40831): tablet aa57d2dbe8a941c591abafe2f7c54e31 (table test-table [id=e871c5dd3a014debab73086aaa240ba7]) successfully deleted
I20260812 11:14:11.082423 31263 raft_consensus.cc:2229] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:14:11.082983 31263 raft_consensus.cc:2258] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:14:11.084621 31260 ts_tablet_manager.cc:1905] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:14:11.089814 31211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:11.066195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35694 (local address 127.4.26.65:33263)
0812 11:14:11.066361 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:11.066367 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:11.066892 (+ 525us) server_negotiation.cc:407] Connection header received
0812 11:14:11.067195 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:11.067201 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:11.067318 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:11.067392 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:11.069742 (+ 2350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:11.071090 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:11.073294 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:11.074098 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:11.074202 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:11.080760 (+ 6558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:11.080782 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:11.080803 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:11.080855 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:11.085596 (+ 4741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:11.086801 (+ 1205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:11.086813 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:11.086817 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:11.087048 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:11.087641 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:11.087647 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:11.087650 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:11.088205 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:11.088566 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:11.089094 (+ 528us) server_negotiation.cc:299] Negotiation successful
0812 11:14:11.089401 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:14:11.090569 30705 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:14:11.092849 31260 ts_tablet_manager.cc:1918] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:14:11.093052 31260 log.cc:1196] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/aa57d2dbe8a941c591abafe2f7c54e31
I20260812 11:14:11.093657 31260 ts_tablet_manager.cc:1939] T aa57d2dbe8a941c591abafe2f7c54e31 P 8adaa307ca4f484ab8576f4e87b3871b: Deleting consensus metadata
I20260812 11:14:11.096272 30362 catalog_manager.cc:4841] TS 8adaa307ca4f484ab8576f4e87b3871b (127.4.26.66:43463): tablet aa57d2dbe8a941c591abafe2f7c54e31 (table test-table [id=e871c5dd3a014debab73086aaa240ba7]) successfully deleted
I20260812 11:14:11.198060 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 30488
W20260812 11:14:11.229758 30367 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.26.65:33263 (error 108)
I20260812 11:14:11.229919 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 30724
I20260812 11:14:11.231839 31204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:11.231345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33263 (local address 127.0.0.1:35706)
0812 11:14:11.231518 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:11.231637 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 11:14:11.232147 30367 catalog_manager.cc:4584] TS df151cb0ae45474cba93241cb45a3b3a (127.4.26.65:33263): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet aa57d2dbe8a941c591abafe2f7c54e31: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33263: connect: Connection refused (error 111)
Aug 12 11:14:11 dist-test-slave-rmhg krb5kdc[30317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:14:11.251842 31213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:11.230855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47816 (local address 127.4.26.66:43463)
0812 11:14:11.231050 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:11.231057 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:11.231142 (+ 85us) server_negotiation.cc:407] Connection header received
0812 11:14:11.231361 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:11.231367 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:11.231467 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:11.231585 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:11.233290 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:11.234456 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:11.235944 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:11.236618 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:11.236755 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:11.244141 (+ 7386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:11.244164 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:11.244187 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:11.244248 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:11.248382 (+ 4134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:11.249284 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:11.249295 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:11.249299 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:11.249476 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:11.249933 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:11.249939 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:11.249943 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:11.250503 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:11.250823 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:11.251230 (+ 407us) server_negotiation.cc:299] Negotiation successful
0812 11:14:11.251468 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 11:14:11.252686 30945 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:14:11.286132 31204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:11.285555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33263 (local address 127.0.0.1:35710)
0812 11:14:11.285818 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:11.285942 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260812 11:14:11.287410 31204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:11.286988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33263 (local address 127.0.0.1:35712)
0812 11:14:11.287150 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:11.287259 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 11:14:11.344722 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 30724
I20260812 11:14:11.347802 31204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:11.347360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33263 (local address 127.0.0.1:35716)
0812 11:14:11.347556 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:11.347642 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260812 11:14:11.348856 31204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:11.348496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33263 (local address 127.0.0.1:35722)
0812 11:14:11.348659 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:11.348733 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260812 11:14:11.369953 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 30960
Aug 12 11:14:11 dist-test-slave-rmhg krb5kdc[30317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533248, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:14:11.389139 31207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:11.370750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34868 (local address 127.4.26.67:40831)
0812 11:14:11.370926 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:11.370930 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:11.370948 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:14:11.371152 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:11.371156 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:11.371232 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:11.371312 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:11.373208 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:11.374041 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:11.376112 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:11.376578 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:11.376725 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:11.382623 (+ 5898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:11.382645 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:11.382664 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:11.382708 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:11.386038 (+ 3330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:11.386861 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:11.386870 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:11.386872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:11.387063 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:11.387473 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:11.387477 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:11.387479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:11.387862 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:11.388188 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:11.388553 (+ 365us) server_negotiation.cc:299] Negotiation successful
0812 11:14:11.388779 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 11:14:11.389894 31174 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:14:11.429834 31204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:11.429275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33263 (local address 127.0.0.1:35724)
0812 11:14:11.429529 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:11.429638 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260812 11:14:11.431216 31204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:11.430683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33263 (local address 127.0.0.1:35738)
0812 11:14:11.430941 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:11.431080 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137}
I20260812 11:14:11.516192 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 30960
I20260812 11:14:11.542817 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 30339
I20260812 11:14:11.543980 30434 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:14:11.656962 31204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:11.656344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33263 (local address 127.0.0.1:35740)
0812 11:14:11.656534 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:11.656672 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:33263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 11:14:11.657562 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 30339
I20260812 11:14:31.686808 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:41095
--webserver_interface=127.4.26.126
--webserver_port=39593
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:41095
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:14:32.049425 31278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:14:32.049790 31278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:14:32.049942 31278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:14:32.057653 31278 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 11:14:32.057789 31278 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 11:14:32.057859 31278 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 11:14:32.057934 31278 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:14:32.058012 31278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:14:32.058109 31278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:14:32.058172 31278 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:14:32.058250 31278 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:14:32.068821 31278 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:41095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:41095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=39593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:14:32.070272 31278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:14:32.071715 31278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:14:32.098130 31288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:32.098233 31286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:32.098148 31285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:14:32.099099 31278 server_base.cc:1034] running on GCE node
I20260812 11:14:32.100135 31278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:14:32.102012 31278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:14:32.103271 31278 hybrid_clock.cc:648] HybridClock initialized: now 1786533272103191 us; error 48 us; skew 500 ppm
I20260812 11:14:32.103767 31278 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:14:32 dist-test-slave-rmhg krb5kdc[30317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533272, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:14:32.115782 31278 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:14:32.117835 31278 webserver.cc:460] Webserver started at http://127.4.26.126:39593/ using document root <none> and password file <none>
I20260812 11:14:32.118803 31278 fs_manager.cc:359] Metadata directory not provided
I20260812 11:14:32.118939 31278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:14:32.125818 31278 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:14:32.129336 31298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:32.130964 31278 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:14:32.131186 31278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "f291c679cc8b45a183e067b310a9f4e1"
format_stamp: "Formatted at 2026-08-12 11:14:08 on dist-test-slave-rmhg"
server_key: "891f5c9054777c404ae7d5c9d25075f6"
server_key_iv: "bc14cd2c603b0a18b2295cbe8ce6388e"
server_key_version: "encryptionkey@0"
I20260812 11:14:32.132398 31278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:14:32.152714 31278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:14:32.157997 31278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:14:32.158335 31278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:14:32.178736 31278 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:41095
I20260812 11:14:32.178776 31380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:41095 every 8 connection(s)
I20260812 11:14:32.180568 31278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:14:32.188390 31382 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:14:32.190143 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 31278
I20260812 11:14:32.191233 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:33263
--local_ip_for_outbound_sockets=127.4.26.65
--tserver_master_addrs=127.4.26.126:41095
--webserver_port=41429
--webserver_interface=127.4.26.65
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:14:32.193272 31382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Bootstrap starting.
I20260812 11:14:32.218101 31382 log.cc:824] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Log is configured to *not* fsync() on all Append() calls
I20260812 11:14:32.233136 31382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:14:32.233786 31382 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Bootstrap complete.
I20260812 11:14:32.243739 31382 raft_consensus.cc:348] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } }
I20260812 11:14:32.244731 31382 raft_consensus.cc:729] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f291c679cc8b45a183e067b310a9f4e1, State: Initialized, Role: FOLLOWER
I20260812 11:14:32.245510 31382 consensus_queue.cc:260] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } }
I20260812 11:14:32.245772 31382 raft_consensus.cc:388] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:14:32.245908 31382 raft_consensus.cc:482] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:14:32.246115 31382 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 1 FOLLOWER]: Advancing to term 2
I20260812 11:14:32.250684 31382 raft_consensus.cc:504] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } }
I20260812 11:14:32.251333 31382 leader_election.cc:302] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f291c679cc8b45a183e067b310a9f4e1; no voters:
I20260812 11:14:32.252017 31382 leader_election.cc:288] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260812 11:14:32.252171 31392 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 11:14:32.253548 31392 raft_consensus.cc:686] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 2 LEADER]: Becoming Leader. State: Replica: f291c679cc8b45a183e067b310a9f4e1, State: Running, Role: LEADER
I20260812 11:14:32.254194 31392 consensus_queue.cc:237] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } }
I20260812 11:14:32.254763 31382 sys_catalog.cc:564] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:14:32.257349 31396 sys_catalog.cc:455] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f291c679cc8b45a183e067b310a9f4e1. Latest consensus state: current_term: 2 leader_uuid: "f291c679cc8b45a183e067b310a9f4e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } } }
I20260812 11:14:32.257808 31396 sys_catalog.cc:458] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [sys.catalog]: This master's current role is: LEADER
I20260812 11:14:32.258455 31394 sys_catalog.cc:455] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f291c679cc8b45a183e067b310a9f4e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } } }
I20260812 11:14:32.258769 31394 sys_catalog.cc:458] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [sys.catalog]: This master's current role is: LEADER
I20260812 11:14:32.265867 31400 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:14:32.275527 31400 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:14:32.277268 31400 catalog_manager.cc:1259] Loaded cluster ID: 11df7e28e2384cad983e059acf0233dc
I20260812 11:14:32.277405 31400 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:14:32.281927 31400 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:14:32.283777 31400 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Loaded TSK: 0
I20260812 11:14:32.320256 31400 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Generated new TSK 1
I20260812 11:14:32.320744 31400 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:14:32.601693 31388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:14:32.602044 31388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:14:32.602197 31388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:14:32.610222 31388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:14:32.610385 31388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:14:32.610548 31388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:14:32.621212 31388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:33263
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=41429
--tserver_master_addrs=127.4.26.126:41095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:14:32.622614 31388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:14:32.623960 31388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:14:32.640339 31435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:32.640357 31437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:32.640391 31439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:14:32.641801 31388 server_base.cc:1034] running on GCE node
I20260812 11:14:32.642558 31388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:14:32.643687 31388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:14:32.644912 31388 hybrid_clock.cc:648] HybridClock initialized: now 1786533272644851 us; error 56 us; skew 500 ppm
I20260812 11:14:32.645321 31388 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:14:32 dist-test-slave-rmhg krb5kdc[30317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533272, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:14:32.649094 31388 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:14:32.650954 31388 webserver.cc:460] Webserver started at http://127.4.26.65:41429/ using document root <none> and password file <none>
I20260812 11:14:32.651715 31388 fs_manager.cc:359] Metadata directory not provided
I20260812 11:14:32.651859 31388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:14:32.658255 31388 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:14:32.661629 31449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:32.663391 31388 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:14:32.663585 31388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "df151cb0ae45474cba93241cb45a3b3a"
format_stamp: "Formatted at 2026-08-12 11:14:09 on dist-test-slave-rmhg"
server_key: "364e09347ec0e7f05657b637d2e65914"
server_key_iv: "7a8a71c098543db4aa54dac4f82e1fcc"
server_key_version: "encryptionkey@0"
I20260812 11:14:32.665010 31388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:14:32.693761 31388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:14:32.698318 31388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:14:32.698625 31388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:14:32.699663 31388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:14:32.701846 31462 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 11:14:32.708139 31388 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 11:14:32.708276 31388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260812 11:14:32.708416 31388 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260812 11:14:32.711949 31388 ts_tablet_manager.cc:610] Registered 1 tablets
I20260812 11:14:32.712070 31388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.001s sys 0.000s
I20260812 11:14:32.712574 31462 tablet_bootstrap.cc:492] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: Bootstrap starting.
I20260812 11:14:32.722784 31462 log.cc:824] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:14:32.743207 31462 tablet_bootstrap.cc:492] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:14:32.744237 31462 tablet_bootstrap.cc:492] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: Bootstrap complete.
I20260812 11:14:32.744963 31462 ts_tablet_manager.cc:1397] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: Time spent bootstrapping tablet: real 0.033s user 0.025s sys 0.005s
I20260812 11:14:32.750977 31388 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:33263
I20260812 11:14:32.751061 31643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:33263 every 8 connection(s)
I20260812 11:14:32.752456 31388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:14:32.754698 31462 raft_consensus.cc:348] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:32.756021 31462 raft_consensus.cc:729] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: df151cb0ae45474cba93241cb45a3b3a, State: Initialized, Role: FOLLOWER
I20260812 11:14:32.756877 31462 consensus_queue.cc:260] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:32.760237 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 31388
I20260812 11:14:32.761128 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:43463
--local_ip_for_outbound_sockets=127.4.26.66
--tserver_master_addrs=127.4.26.126:41095
--webserver_port=41257
--webserver_interface=127.4.26.66
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:14:32.777114 31462 ts_tablet_manager.cc:1428] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: Time spent starting tablet: real 0.032s user 0.025s sys 0.007s
Aug 12 11:14:32 dist-test-slave-rmhg krb5kdc[30317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533272, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:14:32.795822 31646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:32.756066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:57233 (local address 127.4.26.126:41095)
0812 11:14:32.769669 (+ 13603us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:32.769691 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:32.769754 (+ 63us) server_negotiation.cc:407] Connection header received
0812 11:14:32.770267 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:32.770291 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:32.771135 (+ 844us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:32.771718 (+ 583us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:32.775819 (+ 4101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:32.777810 (+ 1991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:32.780646 (+ 2836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:32.781881 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:32.782159 (+ 278us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:32.786751 (+ 4592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:32.786762 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:32.786783 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:32.786833 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:32.790211 (+ 3378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:32.791515 (+ 1304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:32.791525 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:32.791532 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:32.791760 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:32.792332 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:32.792336 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:32.792338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:32.793039 (+ 701us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:32.793236 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:32.794448 (+ 1212us) server_negotiation.cc:299] Negotiation successful
0812 11:14:32.794829 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13281,"thread_start_us":16198,"threads_started":1}
I20260812 11:14:32.796128 31647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:32.755998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:57233)
0812 11:14:32.766817 (+ 10819us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:32.766895 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0812 11:14:32.767681 (+ 786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:14:32.773091 (+ 5410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:14:32.773106 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:14:32.774237 (+ 1131us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:14:32.775402 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:32.775444 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:32.778190 (+ 2746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:32.778196 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:32.780366 (+ 2170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:32.780392 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:32.782267 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:32.782274 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:32.782552 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:32.783344 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:14:32.783377 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:14:32.786349 (+ 2972us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:14:32.790475 (+ 4126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:14:32.790488 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:14:32.790511 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:14:32.791290 (+ 779us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:14:32.791909 (+ 619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:14:32.791913 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:14:32.791917 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:14:32.792191 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:14:32.793233 (+ 1042us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:14:32.793243 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:14:32.793755 (+ 512us) client_negotiation.cc:769] Sending connection context
0812 11:14:32.794121 (+ 366us) client_negotiation.cc:240] Negotiation successful
0812 11:14:32.794765 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10348,"thread_start_us":13845,"threads_started":1}
I20260812 11:14:32.799657 31644 heartbeater.cc:347] Connected to a master server at 127.4.26.126:41095
I20260812 11:14:32.800045 31644 heartbeater.cc:464] Registering TS with master...
I20260812 11:14:32.801065 31644 heartbeater.cc:511] Master 127.4.26.126:41095 requested a full tablet report, sending...
I20260812 11:14:32.805249 31331 ts_manager.cc:194] Registered new tserver with Master: df151cb0ae45474cba93241cb45a3b3a (127.4.26.65:33263)
I20260812 11:14:32.811005 31331 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:57233
I20260812 11:14:32.815171 31644 heartbeater.cc:503] Master 127.4.26.126:41095 was elected leader, sending a full tablet report...
I20260812 11:14:32.820979 31651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:32.809985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33263 (local address 127.0.0.1:51292)
0812 11:14:32.813015 (+ 3030us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:32.813077 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 11:14:32.813371 (+ 294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:14:32.814294 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:14:32.814301 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:14:32.814333 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:14:32.814711 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:32.814725 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:32.816693 (+ 1968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:32.816699 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:32.818336 (+ 1637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:32.818350 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:32.820212 (+ 1862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:32.820219 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:32.820389 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:32.820426 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:14:32.820545 (+ 119us) client_negotiation.cc:240] Negotiation successful
0812 11:14:32.820713 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2673,"thread_start_us":2655,"threads_started":1}
I20260812 11:14:32.821106 31652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:32.810210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51292 (local address 127.4.26.65:33263)
0812 11:14:32.812620 (+ 2410us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:32.812629 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:32.813216 (+ 587us) server_negotiation.cc:407] Connection header received
0812 11:14:32.813634 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:32.813647 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:32.814049 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:32.814249 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:14:32.814911 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:32.816515 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:32.818500 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:32.819936 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:32.820085 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:32.820324 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:32.820605 (+ 281us) server_negotiation.cc:299] Negotiation successful
0812 11:14:32.820775 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2210,"thread_start_us":2008,"threads_started":1}
I20260812 11:14:32.822605 31534 tablet_service.cc:1514] Processing DeleteTablet for tablet aa57d2dbe8a941c591abafe2f7c54e31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:14:11 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:51292
I20260812 11:14:32.825245 31654 tablet_replica.cc:330] stopping tablet replica
I20260812 11:14:32.825631 31654 raft_consensus.cc:2229] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:14:32.826035 31654 raft_consensus.cc:2258] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:14:32.827284 31654 ts_tablet_manager.cc:1905] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:14:32.834836 31654 ts_tablet_manager.cc:1918] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:14:32.835001 31654 log.cc:1196] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/aa57d2dbe8a941c591abafe2f7c54e31
I20260812 11:14:32.835435 31654 ts_tablet_manager.cc:1939] T aa57d2dbe8a941c591abafe2f7c54e31 P df151cb0ae45474cba93241cb45a3b3a: Deleting consensus metadata
I20260812 11:14:32.837937 31304 catalog_manager.cc:4841] TS df151cb0ae45474cba93241cb45a3b3a (127.4.26.65:33263): tablet aa57d2dbe8a941c591abafe2f7c54e31 (table test-table [id=e871c5dd3a014debab73086aaa240ba7]) successfully deleted
W20260812 11:14:33.130641 31650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:14:33.130976 31650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:14:33.131117 31650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:14:33.138798 31650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:14:33.138943 31650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:14:33.139098 31650 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:14:33.150004 31650 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:43463
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=41257
--tserver_master_addrs=127.4.26.126:41095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:14:33.151417 31650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:14:33.152842 31650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:14:33.167779 31662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:33.167733 31663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:33.167800 31665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:14:33.168390 31650 server_base.cc:1034] running on GCE node
I20260812 11:14:33.169200 31650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:14:33.170286 31650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:14:33.171517 31650 hybrid_clock.cc:648] HybridClock initialized: now 1786533273171448 us; error 71 us; skew 500 ppm
I20260812 11:14:33.171878 31650 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:14:33 dist-test-slave-rmhg krb5kdc[30317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533273, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:14:33.175242 31650 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:14:33.176970 31650 webserver.cc:460] Webserver started at http://127.4.26.66:41257/ using document root <none> and password file <none>
I20260812 11:14:33.177802 31650 fs_manager.cc:359] Metadata directory not provided
I20260812 11:14:33.178041 31650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:14:33.185732 31650 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.003s
I20260812 11:14:33.189275 31674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:33.191048 31650 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:14:33.191252 31650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "8adaa307ca4f484ab8576f4e87b3871b"
format_stamp: "Formatted at 2026-08-12 11:14:09 on dist-test-slave-rmhg"
server_key: "d19ae44fa5d5cc86b551b0ac135005b3"
server_key_iv: "89f375c30340832abe7968d9b165159e"
server_key_version: "encryptionkey@0"
I20260812 11:14:33.192667 31650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:14:33.213419 31650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:14:33.218189 31650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:14:33.218458 31650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:14:33.219555 31650 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:14:33.221208 31650 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:14:33.221328 31650 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 11:14:33.221449 31650 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:14:33.221535 31650 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:33.254211 31650 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:43463
I20260812 11:14:33.254262 31856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:43463 every 8 connection(s)
I20260812 11:14:33.255887 31650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:14:33.262519 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 31650
I20260812 11:14:33.263222 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:40831
--local_ip_for_outbound_sockets=127.4.26.67
--tserver_master_addrs=127.4.26.126:41095
--webserver_port=42837
--webserver_interface=127.4.26.67
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 12 11:14:33 dist-test-slave-rmhg krb5kdc[30317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533273, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:14:33.279692 31646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:33.258642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:47881 (local address 127.4.26.126:41095)
0812 11:14:33.258873 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:33.258879 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:33.260175 (+ 1296us) server_negotiation.cc:407] Connection header received
0812 11:14:33.262161 (+ 1986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:33.262167 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:33.262291 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:33.262432 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:33.264299 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.265466 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.267419 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.267995 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.268133 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:33.272344 (+ 4211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:33.272352 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:33.272357 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:33.272416 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:33.275743 (+ 3327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:33.276889 (+ 1146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:33.276895 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:33.276898 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:33.277067 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:33.277696 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:33.277701 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:33.277704 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:33.278109 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:33.278269 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:33.279157 (+ 888us) server_negotiation.cc:299] Negotiation successful
0812 11:14:33.279392 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260812 11:14:33.281244 31862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:33.259167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:47881)
0812 11:14:33.259951 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:33.260022 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0812 11:14:33.261806 (+ 1784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:14:33.262698 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:14:33.262711 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:14:33.263334 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:14:33.264047 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:33.264069 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.265703 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.265708 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:33.267249 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:33.267263 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.268273 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.268280 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:33.268601 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:33.269481 (+ 880us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:14:33.269512 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:14:33.272020 (+ 2508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:14:33.275956 (+ 3936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:14:33.275969 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:14:33.275992 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:14:33.276717 (+ 725us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:14:33.277219 (+ 502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:14:33.277224 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:14:33.277227 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:14:33.277507 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:14:33.278251 (+ 744us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:14:33.278259 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:14:33.278740 (+ 481us) client_negotiation.cc:769] Sending connection context
0812 11:14:33.279055 (+ 315us) client_negotiation.cc:240] Negotiation successful
0812 11:14:33.279706 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":313,"threads_started":1}
I20260812 11:14:33.283098 31859 heartbeater.cc:347] Connected to a master server at 127.4.26.126:41095
I20260812 11:14:33.283442 31859 heartbeater.cc:464] Registering TS with master...
I20260812 11:14:33.284247 31859 heartbeater.cc:511] Master 127.4.26.126:41095 requested a full tablet report, sending...
I20260812 11:14:33.286065 31331 ts_manager.cc:194] Registered new tserver with Master: 8adaa307ca4f484ab8576f4e87b3871b (127.4.26.66:43463)
I20260812 11:14:33.287163 31331 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:47881
W20260812 11:14:33.628695 31867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:14:33.629005 31867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:14:33.629124 31867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:14:33.636831 31867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:14:33.637020 31867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:14:33.637202 31867 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:14:33.647972 31867 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:40831
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=42837
--tserver_master_addrs=127.4.26.126:41095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:14:33.649437 31867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:14:33.650806 31867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:14:33.664600 31875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:33.664739 31873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:33.664752 31877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:14:33.665812 31867 server_base.cc:1034] running on GCE node
I20260812 11:14:33.666420 31867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:14:33.667414 31867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:14:33.668686 31867 hybrid_clock.cc:648] HybridClock initialized: now 1786533273668616 us; error 52 us; skew 500 ppm
I20260812 11:14:33.669044 31867 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:14:33 dist-test-slave-rmhg krb5kdc[30317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533273, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:14:33.672398 31867 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:14:33.674170 31867 webserver.cc:460] Webserver started at http://127.4.26.67:42837/ using document root <none> and password file <none>
I20260812 11:14:33.674901 31867 fs_manager.cc:359] Metadata directory not provided
I20260812 11:14:33.675036 31867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:14:33.681468 31867 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:14:33.684723 31891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:33.686367 31867 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:14:33.686549 31867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2"
format_stamp: "Formatted at 2026-08-12 11:14:10 on dist-test-slave-rmhg"
server_key: "7f348fa14ace5be61e0c5ccb88e93e63"
server_key_iv: "71115408bd0a805b8afdb9314ad543d3"
server_key_version: "encryptionkey@0"
I20260812 11:14:33.687580 31867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:14:33.712389 31867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:14:33.717060 31867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:14:33.717409 31867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:14:33.718578 31867 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:14:33.720196 31867 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:14:33.720320 31867 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:33.720440 31867 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:14:33.720516 31867 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:33.753804 31867 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:40831
I20260812 11:14:33.753859 32075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:40831 every 8 connection(s)
I20260812 11:14:33.755766 31867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:14:33.759737 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 31867
Aug 12 11:14:33 dist-test-slave-rmhg krb5kdc[30317](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533273, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:14:33.778159 32085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:33.760755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35292 (local address 127.4.26.126:41095)
0812 11:14:33.761334 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:33.761341 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:33.761689 (+ 348us) server_negotiation.cc:407] Connection header received
0812 11:14:33.762232 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:33.762238 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:33.762324 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:33.762442 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:33.764588 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.765834 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.767508 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.768171 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.768301 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:33.771392 (+ 3091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:33.771398 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:33.771403 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:33.771444 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:33.775022 (+ 3578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:33.775853 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:33.775858 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:33.775862 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:33.776047 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:33.776435 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:33.776440 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:33.776443 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:33.776816 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:33.777069 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:33.777517 (+ 448us) server_negotiation.cc:299] Negotiation successful
0812 11:14:33.777749 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"spinlock_wait_cycles":3840,"thread_start_us":251,"threads_started":1}
I20260812 11:14:33.779897 31646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:33.758691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:46529 (local address 127.4.26.126:41095)
0812 11:14:33.758864 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:33.758869 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:33.760545 (+ 1676us) server_negotiation.cc:407] Connection header received
0812 11:14:33.763214 (+ 2669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:33.763219 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:33.763289 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:33.763390 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:33.765503 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.766597 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.768701 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.769271 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.769395 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:33.773213 (+ 3818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:33.773221 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:33.773225 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:33.773282 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:33.776547 (+ 3265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:33.777389 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:33.777393 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:33.777395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:33.777525 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:33.778002 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:33.778005 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:33.778007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:33.778354 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:33.778491 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:33.779383 (+ 892us) server_negotiation.cc:299] Negotiation successful
0812 11:14:33.779563 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58,"spinlock_wait_cycles":3328}
I20260812 11:14:33.781283 32083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:33.759341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:46529)
0812 11:14:33.760332 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:33.760389 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 11:14:33.762874 (+ 2485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:14:33.763719 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:14:33.763733 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:14:33.764519 (+ 786us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:14:33.765335 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:33.765357 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.766774 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.766778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:33.768559 (+ 1781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:33.768572 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.769518 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.769525 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:33.769749 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:33.770464 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:14:33.770488 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:14:33.772961 (+ 2473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:14:33.776702 (+ 3741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:14:33.776712 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:14:33.776729 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:14:33.777270 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:14:33.777670 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:14:33.777675 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:14:33.777678 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:14:33.777881 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:14:33.778515 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:14:33.778525 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:14:33.779001 (+ 476us) client_negotiation.cc:769] Sending connection context
0812 11:14:33.779258 (+ 257us) client_negotiation.cc:240] Negotiation successful
0812 11:14:33.779865 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"thread_start_us":386,"threads_started":1}
I20260812 11:14:33.782850 32079 heartbeater.cc:347] Connected to a master server at 127.4.26.126:41095
I20260812 11:14:33.783167 32079 heartbeater.cc:464] Registering TS with master...
I20260812 11:14:33.783922 32079 heartbeater.cc:511] Master 127.4.26.126:41095 requested a full tablet report, sending...
I20260812 11:14:33.785508 31331 ts_manager.cc:194] Registered new tserver with Master: 4a8cdf8b2dc3466a982a271a3b6f12f2 (127.4.26.67:40831)
I20260812 11:14:33.786365 31331 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:46529
I20260812 11:14:33.793915 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:14:33.801198 31646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:33.795056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35306 (local address 127.4.26.126:41095)
0812 11:14:33.795241 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:33.795245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:33.795595 (+ 350us) server_negotiation.cc:407] Connection header received
0812 11:14:33.795754 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:33.795758 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:33.795911 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:33.796078 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:14:33.796544 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.797442 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.799117 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.799585 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.799689 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:33.800251 (+ 562us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:14:33.800573 (+ 322us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0812 11:14:33.800908 (+ 335us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35306: token expired
Metrics: {"server-negotiator.queue_time_us":66}
W20260812 11:14:33.801364 31646 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35306: token expired
W20260812 11:14:33.801987 31191 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.4.26.126:41095)
I20260812 11:14:33.815546 31646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:33.802498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35314 (local address 127.4.26.126:41095)
0812 11:14:33.802712 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:33.802715 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:33.802732 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:14:33.802832 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:33.802836 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:33.802899 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:33.802991 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:33.804426 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.805247 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.806645 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.807111 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.807204 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:33.810010 (+ 2806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:33.810015 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:33.810024 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:33.810064 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:33.812858 (+ 2794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:33.813679 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:33.813684 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:33.813686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:33.813823 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:33.814141 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:33.814144 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:33.814146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:33.814491 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:33.814704 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:33.815079 (+ 375us) server_negotiation.cc:299] Negotiation successful
0812 11:14:33.815300 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260812 11:14:33.819674 31330 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35314:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:14:33.827834 31330 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:14:33.842049 31534 tablet_service.cc:1467] Processing CreateTablet for tablet 55f6e603743844dbbe97ac32b47e08dd (DEFAULT_TABLE table=test-table [id=74e7255ee5604889b7fb6128980971f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:14:33.843089 31534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55f6e603743844dbbe97ac32b47e08dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:14:33.851064 32102 tablet_bootstrap.cc:492] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a: Bootstrap starting.
I20260812 11:14:33.852743 32102 tablet_bootstrap.cc:654] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a: Neither blocks nor log segments found. Creating new log.
I20260812 11:14:33.856431 32102 tablet_bootstrap.cc:492] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a: No bootstrap required, opened a new log
I20260812 11:14:33.856746 32102 ts_tablet_manager.cc:1397] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260812 11:14:33.857026 32097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:33.840282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:40831 (local address 127.0.0.1:55092)
0812 11:14:33.841343 (+ 1061us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:33.841364 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:14:33.841493 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:14:33.848073 (+ 6580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:14:33.848078 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:14:33.848112 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:14:33.848596 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:33.848610 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.851014 (+ 2404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.851021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:33.853666 (+ 2645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:33.853681 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.856011 (+ 2330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.856021 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:33.856221 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:33.856266 (+ 45us) client_negotiation.cc:769] Sending connection context
0812 11:14:33.856386 (+ 120us) client_negotiation.cc:240] Negotiation successful
0812 11:14:33.856552 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":928,"mutex_wait_us":528,"thread_start_us":710,"threads_started":1}
I20260812 11:14:33.857034 32099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:33.840628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55092 (local address 127.4.26.67:40831)
0812 11:14:33.847330 (+ 6702us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:33.847340 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:33.847379 (+ 39us) server_negotiation.cc:407] Connection header received
0812 11:14:33.847493 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:33.847501 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:33.847809 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:33.848046 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:14:33.849029 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.850821 (+ 1792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.853874 (+ 3053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.855710 (+ 1836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.855879 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:33.856153 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:33.856468 (+ 315us) server_negotiation.cc:299] Negotiation successful
0812 11:14:33.856671 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6528,"thread_start_us":6348,"threads_started":1}
I20260812 11:14:33.857300 32100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:33.840906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:43463 (local address 127.0.0.1:49454)
0812 11:14:33.846511 (+ 5605us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:33.846537 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:14:33.846683 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:14:33.848234 (+ 1551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:14:33.848239 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:14:33.848274 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:14:33.848768 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:33.848783 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.851014 (+ 2231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.851021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:33.853466 (+ 2445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:33.853491 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.856328 (+ 2837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.856336 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:33.856542 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:33.856577 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 11:14:33.856670 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 11:14:33.856821 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5449,"mutex_wait_us":26,"thread_start_us":5266,"threads_started":1}
I20260812 11:14:33.858135 32101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:33.841470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49454 (local address 127.4.26.66:43463)
0812 11:14:33.847653 (+ 6183us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:33.847662 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:33.847689 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:14:33.847780 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:33.847787 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:33.847994 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:33.848960 (+ 966us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:14:33.849234 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.850818 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.853736 (+ 2918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.855717 (+ 1981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.855879 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:33.856114 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:33.857636 (+ 1522us) server_negotiation.cc:299] Negotiation successful
0812 11:14:33.857843 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6014,"thread_start_us":5909,"threads_started":1}
I20260812 11:14:33.858017 32102 raft_consensus.cc:348] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:33.859303 32102 raft_consensus.cc:374] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:14:33.859484 32102 raft_consensus.cc:729] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df151cb0ae45474cba93241cb45a3b3a, State: Initialized, Role: FOLLOWER
I20260812 11:14:33.859766 32102 consensus_queue.cc:260] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:33.860816 32102 ts_tablet_manager.cc:1428] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260812 11:14:33.862293 31755 tablet_service.cc:1467] Processing CreateTablet for tablet 55f6e603743844dbbe97ac32b47e08dd (DEFAULT_TABLE table=test-table [id=74e7255ee5604889b7fb6128980971f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:14:33.862306 31966 tablet_service.cc:1467] Processing CreateTablet for tablet 55f6e603743844dbbe97ac32b47e08dd (DEFAULT_TABLE table=test-table [id=74e7255ee5604889b7fb6128980971f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:14:33.863996 31755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55f6e603743844dbbe97ac32b47e08dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:14:33.863994 31966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55f6e603743844dbbe97ac32b47e08dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:14:33.882122 32109 tablet_bootstrap.cc:492] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2: Bootstrap starting.
I20260812 11:14:33.883235 32110 tablet_bootstrap.cc:492] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b: Bootstrap starting.
I20260812 11:14:33.885501 32109 tablet_bootstrap.cc:654] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2: Neither blocks nor log segments found. Creating new log.
I20260812 11:14:33.886147 32110 tablet_bootstrap.cc:654] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b: Neither blocks nor log segments found. Creating new log.
I20260812 11:14:33.886627 32109 log.cc:824] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2: Log is configured to *not* fsync() on all Append() calls
I20260812 11:14:33.887197 32110 log.cc:824] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b: Log is configured to *not* fsync() on all Append() calls
I20260812 11:14:33.889564 32109 tablet_bootstrap.cc:492] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2: No bootstrap required, opened a new log
I20260812 11:14:33.889860 32109 ts_tablet_manager.cc:1397] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260812 11:14:33.889901 32110 tablet_bootstrap.cc:492] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b: No bootstrap required, opened a new log
I20260812 11:14:33.890151 32110 ts_tablet_manager.cc:1397] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260812 11:14:33.898046 32110 raft_consensus.cc:348] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:33.898233 32109 raft_consensus.cc:348] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:33.898504 32110 raft_consensus.cc:374] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:14:33.898607 32110 raft_consensus.cc:729] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8adaa307ca4f484ab8576f4e87b3871b, State: Initialized, Role: FOLLOWER
I20260812 11:14:33.898638 32109 raft_consensus.cc:374] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:14:33.898712 32109 raft_consensus.cc:729] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a8cdf8b2dc3466a982a271a3b6f12f2, State: Initialized, Role: FOLLOWER
I20260812 11:14:33.899267 32110 consensus_queue.cc:260] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:33.899296 32109 consensus_queue.cc:260] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:33.900460 32079 heartbeater.cc:503] Master 127.4.26.126:41095 was elected leader, sending a full tablet report...
I20260812 11:14:33.900453 31859 heartbeater.cc:503] Master 127.4.26.126:41095 was elected leader, sending a full tablet report...
I20260812 11:14:33.901232 32109 ts_tablet_manager.cc:1428] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260812 11:14:33.901265 32110 ts_tablet_manager.cc:1428] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260812 11:14:33.954813 32115 raft_consensus.cc:482] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:14:33.955157 32115 raft_consensus.cc:504] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:33.957193 32115 leader_election.cc:288] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df151cb0ae45474cba93241cb45a3b3a (127.4.26.65:33263), 8adaa307ca4f484ab8576f4e87b3871b (127.4.26.66:43463)
I20260812 11:14:33.963055 32083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:33.957519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:43463 (local address 127.4.26.67:42523)
0812 11:14:33.957885 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:33.957906 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:14:33.958040 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:14:33.958576 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:14:33.958619 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:14:33.958646 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:14:33.958823 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:33.958834 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.959884 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.959889 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:33.961275 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:33.961291 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.962427 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.962441 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:33.962635 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:33.962664 (+ 29us) client_negotiation.cc:769] Sending connection context
0812 11:14:33.962741 (+ 77us) client_negotiation.cc:240] Negotiation successful
0812 11:14:33.962841 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217}
I20260812 11:14:33.963230 32101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:33.957798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:42523 (local address 127.4.26.66:43463)
0812 11:14:33.957987 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:33.957993 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:33.958016 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:14:33.958222 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:33.958228 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:33.958306 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:33.958390 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:14:33.958991 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.959741 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.961444 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.962254 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.962422 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:33.962530 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:33.962796 (+ 266us) server_negotiation.cc:299] Negotiation successful
0812 11:14:33.962937 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260812 11:14:33.964368 32116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:33.957607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:46807 (local address 127.4.26.65:33263)
0812 11:14:33.958477 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:33.958482 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:33.958966 (+ 484us) server_negotiation.cc:407] Connection header received
0812 11:14:33.959126 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:33.959130 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:33.959189 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:33.959271 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:14:33.959845 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.960595 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.962358 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.963508 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.963650 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:33.963760 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:33.964032 (+ 272us) server_negotiation.cc:299] Negotiation successful
0812 11:14:33.964137 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":739,"thread_start_us":588,"threads_started":1}
I20260812 11:14:33.964257 31795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55f6e603743844dbbe97ac32b47e08dd" candidate_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8adaa307ca4f484ab8576f4e87b3871b" is_pre_election: true
I20260812 11:14:33.964574 32117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:33.957600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33263 (local address 127.4.26.67:46807)
0812 11:14:33.958847 (+ 1247us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:33.958864 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:14:33.959001 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:14:33.959303 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:14:33.959307 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:14:33.959334 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:14:33.959681 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:33.959690 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.960744 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.960748 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:33.962181 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:14:33.962195 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:14:33.963706 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:14:33.963712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:14:33.963880 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:33.963915 (+ 35us) client_negotiation.cc:769] Sending connection context
0812 11:14:33.964017 (+ 102us) client_negotiation.cc:240] Negotiation successful
0812 11:14:33.964150 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1105,"thread_start_us":856,"threads_started":1}
I20260812 11:14:33.964888 31795 raft_consensus.cc:2454] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a8cdf8b2dc3466a982a271a3b6f12f2 in term 0.
I20260812 11:14:33.965595 31892 leader_election.cc:302] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8cdf8b2dc3466a982a271a3b6f12f2, 8adaa307ca4f484ab8576f4e87b3871b; no voters:
I20260812 11:14:33.965493 31569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55f6e603743844dbbe97ac32b47e08dd" candidate_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df151cb0ae45474cba93241cb45a3b3a" is_pre_election: true
I20260812 11:14:33.965986 32115 raft_consensus.cc:2781] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:14:33.965971 31569 raft_consensus.cc:2454] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a8cdf8b2dc3466a982a271a3b6f12f2 in term 0.
I20260812 11:14:33.966161 32115 raft_consensus.cc:482] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:14:33.966290 32115 raft_consensus.cc:3037] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:14:33.969029 32115 raft_consensus.cc:504] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:33.969738 32115 leader_election.cc:288] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [CANDIDATE]: Term 1 election: Requested vote from peers df151cb0ae45474cba93241cb45a3b3a (127.4.26.65:33263), 8adaa307ca4f484ab8576f4e87b3871b (127.4.26.66:43463)
I20260812 11:14:33.970227 31569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55f6e603743844dbbe97ac32b47e08dd" candidate_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df151cb0ae45474cba93241cb45a3b3a"
I20260812 11:14:33.970332 31795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55f6e603743844dbbe97ac32b47e08dd" candidate_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8adaa307ca4f484ab8576f4e87b3871b"
I20260812 11:14:33.970428 31569 raft_consensus.cc:3037] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:14:33.970623 31795 raft_consensus.cc:3037] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:14:33.972878 31569 raft_consensus.cc:2454] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8cdf8b2dc3466a982a271a3b6f12f2 in term 1.
I20260812 11:14:33.972991 31795 raft_consensus.cc:2454] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8cdf8b2dc3466a982a271a3b6f12f2 in term 1.
I20260812 11:14:33.973395 31896 leader_election.cc:302] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8cdf8b2dc3466a982a271a3b6f12f2, df151cb0ae45474cba93241cb45a3b3a; no voters:
I20260812 11:14:33.973814 32115 raft_consensus.cc:2781] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:14:33.974351 32115 raft_consensus.cc:686] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 1 LEADER]: Becoming Leader. State: Replica: 4a8cdf8b2dc3466a982a271a3b6f12f2, State: Running, Role: LEADER
I20260812 11:14:33.974843 32115 consensus_queue.cc:237] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } }
I20260812 11:14:33.980104 31330 catalog_manager.cc:5495] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a8cdf8b2dc3466a982a271a3b6f12f2 (127.4.26.67). New cstate: current_term: 1 leader_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 40831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 } health_report { overall_health: UNKNOWN } } }
W20260812 11:14:34.007699 32080 tablet.cc:2369] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:14:34.008213 31860 tablet.cc:2369] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:14:34.011541 32099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:34.005421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55096 (local address 127.4.26.67:40831)
0812 11:14:34.005626 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:34.005630 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:34.005652 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:14:34.005748 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:34.005751 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:34.005843 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:34.005976 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:14:34.006332 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:34.007068 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:34.009098 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:34.009634 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:34.009742 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:34.010346 (+ 604us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:14:34.010945 (+ 599us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:14:34.011063 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:34.011209 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 11:14:34.011287 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:14:34.020321 31569 raft_consensus.cc:1261] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a [term 1 FOLLOWER]: Refusing update from remote peer 4a8cdf8b2dc3466a982a271a3b6f12f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:14:34.020325 31795 raft_consensus.cc:1261] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b [term 1 FOLLOWER]: Refusing update from remote peer 4a8cdf8b2dc3466a982a271a3b6f12f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:14:34.021415 32119 consensus_queue.cc:1035] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8adaa307ca4f484ab8576f4e87b3871b" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:14:34.021809 32115 consensus_queue.cc:1035] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df151cb0ae45474cba93241cb45a3b3a" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 11:14:34.023978 31645 tablet.cc:2369] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:14:34.047667 31330 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:14:34.047974 31330 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:14:34.051867 31330 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Sending DeleteTablet for 3 replicas of tablet 55f6e603743844dbbe97ac32b47e08dd
I20260812 11:14:34.052909 31534 tablet_service.cc:1514] Processing DeleteTablet for tablet 55f6e603743844dbbe97ac32b47e08dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:14:34 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:51292
I20260812 11:14:34.053066 31755 tablet_service.cc:1514] Processing DeleteTablet for tablet 55f6e603743844dbbe97ac32b47e08dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:14:34 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:49454
I20260812 11:14:34.053171 31966 tablet_service.cc:1514] Processing DeleteTablet for tablet 55f6e603743844dbbe97ac32b47e08dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:14:34 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:55092
I20260812 11:14:34.058430 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 31388
I20260812 11:14:34.068898 32140 tablet_replica.cc:330] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a: stopping tablet replica
I20260812 11:14:34.069185 32140 raft_consensus.cc:2229] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:14:34.069522 32144 tablet_replica.cc:330] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b: stopping tablet replica
I20260812 11:14:34.069537 32140 raft_consensus.cc:2258] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:14:34.070070 32144 raft_consensus.cc:2229] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:14:34.070451 32146 tablet_replica.cc:330] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2: stopping tablet replica
I20260812 11:14:34.070734 32144 raft_consensus.cc:2258] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:14:34.070909 32146 raft_consensus.cc:2229] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:14:34.071425 32140 ts_tablet_manager.cc:1905] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:14:34.071774 32146 raft_consensus.cc:2258] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:14:34.073266 32144 ts_tablet_manager.cc:1905] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:14:34.078789 32140 ts_tablet_manager.cc:1918] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:14:34.079069 32140 log.cc:1196] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/55f6e603743844dbbe97ac32b47e08dd
I20260812 11:14:34.079687 32140 ts_tablet_manager.cc:1939] T 55f6e603743844dbbe97ac32b47e08dd P df151cb0ae45474cba93241cb45a3b3a: Deleting consensus metadata
I20260812 11:14:34.080869 32144 ts_tablet_manager.cc:1918] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:14:34.081056 32144 log.cc:1196] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/55f6e603743844dbbe97ac32b47e08dd
I20260812 11:14:34.081125 31304 catalog_manager.cc:4841] TS df151cb0ae45474cba93241cb45a3b3a (127.4.26.65:33263): tablet 55f6e603743844dbbe97ac32b47e08dd (table test-table [id=74e7255ee5604889b7fb6128980971f4]) successfully deleted
I20260812 11:14:34.081708 32144 ts_tablet_manager.cc:1939] T 55f6e603743844dbbe97ac32b47e08dd P 8adaa307ca4f484ab8576f4e87b3871b: Deleting consensus metadata
I20260812 11:14:34.081676 32146 ts_tablet_manager.cc:1905] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:14:34.083789 31301 catalog_manager.cc:4841] TS 8adaa307ca4f484ab8576f4e87b3871b (127.4.26.66:43463): tablet 55f6e603743844dbbe97ac32b47e08dd (table test-table [id=74e7255ee5604889b7fb6128980971f4]) successfully deleted
I20260812 11:14:34.084830 32116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:34.060991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51298 (local address 127.4.26.65:33263)
0812 11:14:34.061319 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:34.061326 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:34.061355 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:14:34.061438 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:34.061445 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:34.061538 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:34.061672 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:34.064026 (+ 2354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:34.065356 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:34.067736 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:34.068542 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:34.068683 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:34.073537 (+ 4854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:34.073557 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:34.073578 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:34.073637 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:34.077827 (+ 4190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:34.078995 (+ 1168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:34.079006 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:34.079010 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:34.079222 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:34.081689 (+ 2467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:34.081696 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:34.081699 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:34.082308 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:34.082641 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:34.084169 (+ 1528us) server_negotiation.cc:299] Negotiation successful
0812 11:14:34.084473 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 11:14:34.085813 31637 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:14:34.090432 32146 ts_tablet_manager.cc:1918] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:14:34.090622 32146 log.cc:1196] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/55f6e603743844dbbe97ac32b47e08dd
I20260812 11:14:34.091241 32146 ts_tablet_manager.cc:1939] T 55f6e603743844dbbe97ac32b47e08dd P 4a8cdf8b2dc3466a982a271a3b6f12f2: Deleting consensus metadata
I20260812 11:14:34.093055 31305 catalog_manager.cc:4841] TS 4a8cdf8b2dc3466a982a271a3b6f12f2 (127.4.26.67:40831): tablet 55f6e603743844dbbe97ac32b47e08dd (table test-table [id=74e7255ee5604889b7fb6128980971f4]) successfully deleted
I20260812 11:14:34.218402 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 31388
I20260812 11:14:34.247443 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 31650
I20260812 11:14:34.269858 32101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:34.248299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49466 (local address 127.4.26.66:43463)
0812 11:14:34.248526 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:34.248533 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:34.248556 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:14:34.248625 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:34.248630 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:34.248715 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:34.248834 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:34.250176 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:34.251323 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:34.252549 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:34.253222 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:34.253369 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:34.261682 (+ 8313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:34.261699 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:34.261720 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:34.261777 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:34.265861 (+ 4084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:34.266941 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:34.266953 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:34.266956 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:34.267137 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:34.267592 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:34.267598 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:34.267601 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:34.268187 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:34.268513 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:34.268987 (+ 474us) server_negotiation.cc:299] Negotiation successful
0812 11:14:34.269459 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260812 11:14:34.270666 31851 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:14:34.361775 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 31650
I20260812 11:14:34.386891 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 31867
I20260812 11:14:34.403360 32099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:34.387729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55106 (local address 127.4.26.67:40831)
0812 11:14:34.387912 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 11:14:34.387917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:14:34.387940 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:14:34.388151 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:14:34.388157 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:14:34.388240 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:14:34.388347 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:14:34.389675 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:34.390591 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:34.392111 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:14:34.392609 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:14:34.392716 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:14:34.396302 (+ 3586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:14:34.396318 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:14:34.396336 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:14:34.396378 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:14:34.399765 (+ 3387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:34.400848 (+ 1083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:34.400857 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:34.400859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:34.401043 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:14:34.401603 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:14:34.401608 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:14:34.401611 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:14:34.402100 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:14:34.402368 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0812 11:14:34.402803 (+ 435us) server_negotiation.cc:299] Negotiation successful
0812 11:14:34.402982 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260812 11:14:34.404050 32070 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:14:34.529567 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 31867
I20260812 11:14:34.558159 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 31278
I20260812 11:14:34.559365 31374 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:14:34.672411 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 31278
I20260812 11:14:54.702663 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:41095
--webserver_interface=127.4.26.126
--webserver_port=39593
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:41095
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:14:55.067687 32155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:14:55.068014 32155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:14:55.068131 32155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:14:55.075682 32155 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260812 11:14:55.075804 32155 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260812 11:14:55.075842 32155 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260812 11:14:55.075896 32155 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:14:55.075974 32155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:14:55.076059 32155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:14:55.076107 32155 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:14:55.076175 32155 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:14:55.086755 32155 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:41095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:41095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=39593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:14:55.088199 32155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:14:55.089679 32155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:14:55.102425 32160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:55.102348 32166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:55.102385 32161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:14:55.103591 32155 server_base.cc:1034] running on GCE node
I20260812 11:14:55.104408 32155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:14:55.105999 32155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:14:55.107241 32155 hybrid_clock.cc:648] HybridClock initialized: now 1786533295107156 us; error 55 us; skew 500 ppm
I20260812 11:14:55.107579 32155 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:14:55 dist-test-slave-rmhg krb5kdc[30317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533295, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:14:55.114524 32155 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:14:55.116202 32155 webserver.cc:460] Webserver started at http://127.4.26.126:39593/ using document root <none> and password file <none>
I20260812 11:14:55.117211 32155 fs_manager.cc:359] Metadata directory not provided
I20260812 11:14:55.117337 32155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:14:55.123471 32155 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260812 11:14:55.126693 32176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:55.128273 32155 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:14:55.128469 32155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "f291c679cc8b45a183e067b310a9f4e1"
format_stamp: "Formatted at 2026-08-12 11:14:08 on dist-test-slave-rmhg"
server_key: "891f5c9054777c404ae7d5c9d25075f6"
server_key_iv: "bc14cd2c603b0a18b2295cbe8ce6388e"
server_key_version: "encryptionkey@0"
I20260812 11:14:55.129609 32155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:14:55.141870 32155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:14:55.146670 32155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:14:55.146981 32155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:14:55.165959 32155 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:41095
I20260812 11:14:55.165998 32268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:41095 every 8 connection(s)
I20260812 11:14:55.167613 32155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:14:55.175014 32271 sys_catalog.cc:263] Verifying existing consensus state
I20260812 11:14:55.176829 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 32155
I20260812 11:14:55.177781 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:33263
--local_ip_for_outbound_sockets=127.4.26.65
--tserver_master_addrs=127.4.26.126:41095
--webserver_port=41429
--webserver_interface=127.4.26.65
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:14:55.178754 32271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Bootstrap starting.
I20260812 11:14:55.199751 32271 log.cc:824] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Log is configured to *not* fsync() on all Append() calls
I20260812 11:14:55.217963 32271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 11:14:55.218564 32271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Bootstrap complete.
I20260812 11:14:55.228602 32271 raft_consensus.cc:348] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } }
I20260812 11:14:55.229641 32271 raft_consensus.cc:729] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f291c679cc8b45a183e067b310a9f4e1, State: Initialized, Role: FOLLOWER
I20260812 11:14:55.230310 32271 consensus_queue.cc:260] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } }
I20260812 11:14:55.230557 32271 raft_consensus.cc:388] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:14:55.230679 32271 raft_consensus.cc:482] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:14:55.230842 32271 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 2 FOLLOWER]: Advancing to term 3
I20260812 11:14:55.235247 32271 raft_consensus.cc:504] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } }
I20260812 11:14:55.235811 32271 leader_election.cc:302] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f291c679cc8b45a183e067b310a9f4e1; no voters:
I20260812 11:14:55.236479 32271 leader_election.cc:288] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260812 11:14:55.236724 32275 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 11:14:55.237776 32275 raft_consensus.cc:686] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [term 3 LEADER]: Becoming Leader. State: Replica: f291c679cc8b45a183e067b310a9f4e1, State: Running, Role: LEADER
I20260812 11:14:55.238461 32275 consensus_queue.cc:237] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } }
I20260812 11:14:55.238765 32271 sys_catalog.cc:564] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:14:55.242801 32276 sys_catalog.cc:455] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "f291c679cc8b45a183e067b310a9f4e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } } }
I20260812 11:14:55.243230 32276 sys_catalog.cc:458] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [sys.catalog]: This master's current role is: LEADER
I20260812 11:14:55.243784 32277 sys_catalog.cc:455] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f291c679cc8b45a183e067b310a9f4e1. Latest consensus state: current_term: 3 leader_uuid: "f291c679cc8b45a183e067b310a9f4e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f291c679cc8b45a183e067b310a9f4e1" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 41095 } } }
I20260812 11:14:55.244081 32277 sys_catalog.cc:458] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1 [sys.catalog]: This master's current role is: LEADER
I20260812 11:14:55.248591 32293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:14:55.259660 32293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:14:55.260967 32293 catalog_manager.cc:1259] Loaded cluster ID: 11df7e28e2384cad983e059acf0233dc
I20260812 11:14:55.261096 32293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:14:55.264129 32293 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:14:55.266024 32293 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Loaded TSK: 0
I20260812 11:14:55.266222 32293 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f291c679cc8b45a183e067b310a9f4e1: Loaded TSK: 1
F20260812 11:14:55.267508 32293 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f404be989ad google::LogMessage::Fail() at ??:0
@ 0x7f404be9b88a google::LogMessage::SendToLog() at ??:0
@ 0x7f404be984de google::LogMessage::Flush() at ??:0
@ 0x7f404be99a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f404fbfc7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f404fbeb73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f40618c71c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f40618c6783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f40619522a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f40619520c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f406199c5e9 std::function<>::operator()() at ??:0
@ 0x7f40618cacdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f40618c8c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f4061950610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f4061950439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f404eae4345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f404eae791c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f404eae7799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f404eac2eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f4051d9c6db start_thread at ??:0
@ 0x7f404ad3261f clone at ??:0
W20260812 11:14:55.578648 32273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:14:55.578974 32273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:14:55.579097 32273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:14:55.587015 32273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:14:55.587162 32273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:14:55.587311 32273 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:14:55.598096 32273 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:33263
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=41429
--tserver_master_addrs=127.4.26.126:41095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:14:55.599578 32273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:14:55.601014 32273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:14:55.615464 32345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:55.615571 32347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:55.615619 32350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:14:55.616288 32273 server_base.cc:1034] running on GCE node
I20260812 11:14:55.616931 32273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:14:55.617967 32273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:14:55.619171 32273 hybrid_clock.cc:648] HybridClock initialized: now 1786533295619116 us; error 46 us; skew 500 ppm
I20260812 11:14:55.619491 32273 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:14:55 dist-test-slave-rmhg krb5kdc[30317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533295, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:14:55.622740 32273 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:14:55.624338 32273 webserver.cc:460] Webserver started at http://127.4.26.65:41429/ using document root <none> and password file <none>
I20260812 11:14:55.625054 32273 fs_manager.cc:359] Metadata directory not provided
I20260812 11:14:55.625207 32273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:14:55.630857 32273 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.004s
I20260812 11:14:55.633864 32364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:55.635339 32273 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:14:55.635524 32273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "df151cb0ae45474cba93241cb45a3b3a"
format_stamp: "Formatted at 2026-08-12 11:14:09 on dist-test-slave-rmhg"
server_key: "364e09347ec0e7f05657b637d2e65914"
server_key_iv: "7a8a71c098543db4aa54dac4f82e1fcc"
server_key_version: "encryptionkey@0"
I20260812 11:14:55.636570 32273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:14:55.667912 32273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:14:55.673264 32273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:14:55.673652 32273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:14:55.674849 32273 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:14:55.676401 32273 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:14:55.676534 32273 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:55.676654 32273 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:14:55.676731 32273 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:55.711686 32273 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:33263
I20260812 11:14:55.711766 32547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:33263 every 8 connection(s)
I20260812 11:14:55.713212 32273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:14:55.718534 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:55.716370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:47899)
0812 11:14:55.717223 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:55.717498 (+ 275us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":307,"threads_started":1}
W20260812 11:14:55.719441 32549 heartbeater.cc:644] Failed to heartbeat to 127.4.26.126:41095 (0 consecutive failures): Network error: Failed to ping master at 127.4.26.126:41095: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
I20260812 11:14:55.719513 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 32273
I20260812 11:14:55.720305 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:43463
--local_ip_for_outbound_sockets=127.4.26.66
--tserver_master_addrs=127.4.26.126:41095
--webserver_port=41257
--webserver_interface=127.4.26.66
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:14:55.720538 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:55.720118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:36153)
0812 11:14:55.720293 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:55.720373 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260812 11:14:55.721566 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:55.721189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:49575)
0812 11:14:55.721340 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:55.721431 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 11:14:55.721860 32549 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:14:56.071341 32553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:14:56.071655 32553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:14:56.071758 32553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:14:56.079133 32553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:14:56.079272 32553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:14:56.079387 32553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:14:56.089452 32553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:43463
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=41257
--tserver_master_addrs=127.4.26.126:41095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:14:56.090884 32553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:14:56.092255 32553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:14:56.106230 32567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:56.106166 32574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:56.106268 32563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:14:56.107161 32553 server_base.cc:1034] running on GCE node
I20260812 11:14:56.107831 32553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:14:56.108834 32553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:14:56.110039 32553 hybrid_clock.cc:648] HybridClock initialized: now 1786533296109992 us; error 48 us; skew 500 ppm
I20260812 11:14:56.110378 32553 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:14:56 dist-test-slave-rmhg krb5kdc[30317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533296, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:14:56.113736 32553 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:14:56.115299 32553 webserver.cc:460] Webserver started at http://127.4.26.66:41257/ using document root <none> and password file <none>
I20260812 11:14:56.116030 32553 fs_manager.cc:359] Metadata directory not provided
I20260812 11:14:56.116160 32553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:14:56.122308 32553 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260812 11:14:56.125631 32586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:56.127153 32553 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:14:56.127334 32553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "8adaa307ca4f484ab8576f4e87b3871b"
format_stamp: "Formatted at 2026-08-12 11:14:09 on dist-test-slave-rmhg"
server_key: "d19ae44fa5d5cc86b551b0ac135005b3"
server_key_iv: "89f375c30340832abe7968d9b165159e"
server_key_version: "encryptionkey@0"
I20260812 11:14:56.128388 32553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:14:56.144088 32553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:14:56.148715 32553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:14:56.148984 32553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:14:56.150027 32553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:14:56.151417 32553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:14:56.151510 32553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:56.151625 32553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:14:56.151697 32553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:56.183320 32553 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:43463
I20260812 11:14:56.183393 307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:43463 every 8 connection(s)
I20260812 11:14:56.184882 32553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:14:56.190284 312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:56.188232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:53633)
0812 11:14:56.189046 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:56.189323 (+ 277us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":327,"threads_started":1}
W20260812 11:14:56.191108 310 heartbeater.cc:644] Failed to heartbeat to 127.4.26.126:41095 (0 consecutive failures): Network error: Failed to ping master at 127.4.26.126:41095: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
I20260812 11:14:56.192013 312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:56.191660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:48327)
0812 11:14:56.191819 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:56.191894 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 11:14:56.192242 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 32553
I20260812 11:14:56.192891 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:40831
--local_ip_for_outbound_sockets=127.4.26.67
--tserver_master_addrs=127.4.26.126:41095
--webserver_port=42837
--webserver_interface=127.4.26.67
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:35865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:14:56.192940 312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:56.192608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:54301)
0812 11:14:56.192748 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:56.192828 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260812 11:14:56.193251 310 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 11:14:56.557114 313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:14:56.557469 313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:14:56.557580 313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:14:56.565230 313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:14:56.565400 313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:14:56.565527 313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:14:56.575815 313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:35865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:40831
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=42837
--tserver_master_addrs=127.4.26.126:41095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:14:56.577212 313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:14:56.578610 313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:14:56.592396 318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:56.592355 324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:14:56.592439 322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:14:56.593343 313 server_base.cc:1034] running on GCE node
I20260812 11:14:56.593998 313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:14:56.595038 313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:14:56.596238 313 hybrid_clock.cc:648] HybridClock initialized: now 1786533296596195 us; error 39 us; skew 500 ppm
I20260812 11:14:56.596570 313 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:14:56 dist-test-slave-rmhg krb5kdc[30317](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533296, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:14:56.599874 313 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:14:56.601532 313 webserver.cc:460] Webserver started at http://127.4.26.67:42837/ using document root <none> and password file <none>
I20260812 11:14:56.602260 313 fs_manager.cc:359] Metadata directory not provided
I20260812 11:14:56.602380 313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:14:56.608526 313 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260812 11:14:56.611797 337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:56.613339 313 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:14:56.613520 313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "4a8cdf8b2dc3466a982a271a3b6f12f2"
format_stamp: "Formatted at 2026-08-12 11:14:10 on dist-test-slave-rmhg"
server_key: "7f348fa14ace5be61e0c5ccb88e93e63"
server_key_iv: "71115408bd0a805b8afdb9314ad543d3"
server_key_version: "encryptionkey@0"
I20260812 11:14:56.614593 313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:14:56.626935 313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:14:56.631543 313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:14:56.631830 313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:14:56.632916 313 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:14:56.634557 313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:14:56.634668 313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:56.634789 313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:14:56.634859 313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:14:56.667651 313 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:40831
I20260812 11:14:56.667722 530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:40831 every 8 connection(s)
I20260812 11:14:56.669217 313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:14:56.674320 534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:56.672316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:41711)
0812 11:14:56.673100 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:56.673369 (+ 269us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":312,"threads_started":1}
W20260812 11:14:56.675037 531 heartbeater.cc:644] Failed to heartbeat to 127.4.26.126:41095 (0 consecutive failures): Network error: Failed to ping master at 127.4.26.126:41095: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
I20260812 11:14:56.675969 534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:56.675573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:52301)
0812 11:14:56.675771 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:56.675849 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260812 11:14:56.676891 534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:56.676555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:56451)
0812 11:14:56.676697 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:56.676779 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 11:14:56.677143 531 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 11:14:56.677899 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 313
I20260812 11:14:56.723467 537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:56.722555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:59271)
0812 11:14:56.723086 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:56.723215 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":233,"threads_started":1}
I20260812 11:14:57.195030 538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:57.194047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:39349)
0812 11:14:57.194665 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:57.194779 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":274,"threads_started":1}
I20260812 11:14:57.678695 539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:57.677799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:39041)
0812 11:14:57.678307 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:57.678408 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":235,"threads_started":1}
I20260812 11:14:57.725406 540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:57.724522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:43479)
0812 11:14:57.725082 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:57.725224 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":266,"threads_started":1}
I20260812 11:14:58.196934 541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:58.196077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:38095)
0812 11:14:58.196625 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:58.196749 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":267,"threads_started":1}
I20260812 11:14:58.680610 544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:58.679681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:44871)
0812 11:14:58.680251 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:58.680364 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":281,"threads_started":1}
I20260812 11:14:58.727236 547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:58.726431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:53085)
0812 11:14:58.726941 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:58.727036 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":292,"threads_started":1}
I20260812 11:14:59.198709 548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:59.197972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:48943)
0812 11:14:59.198426 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:59.198512 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":244,"threads_started":1}
I20260812 11:14:59.682499 550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:59.681723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:41081)
0812 11:14:59.682222 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:59.682317 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":259,"threads_started":1}
I20260812 11:14:59.729206 551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:14:59.728332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:35803)
0812 11:14:59.728870 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0812 11:14:59.728974 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":238,"threads_started":1}
I20260812 11:15:00.200676 552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:00.199844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:35421)
0812 11:15:00.200373 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:00.200467 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":271,"threads_started":1}
I20260812 11:15:00.684370 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:00.683543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:39373)
0812 11:15:00.684071 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:00.684169 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":253,"threads_started":1}
I20260812 11:15:00.730967 556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:00.730204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:54951)
0812 11:15:00.730673 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:00.730763 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":234,"threads_started":1}
I20260812 11:15:01.202701 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:01.201832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:45973)
0812 11:15:01.202378 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:01.202465 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":303,"threads_started":1}
I20260812 11:15:01.686246 559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:01.685483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:34601)
0812 11:15:01.685972 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:01.686065 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":239,"threads_started":1}
I20260812 11:15:01.732816 560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:01.732022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:40179)
0812 11:15:01.732522 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:01.732634 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":238,"threads_started":1}
I20260812 11:15:02.204370 561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:02.203627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:47223)
0812 11:15:02.204088 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:02.204202 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":235,"threads_started":1}
I20260812 11:15:02.688189 562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:02.687315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:41271)
0812 11:15:02.687887 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:02.687988 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":281,"threads_started":1}
I20260812 11:15:02.734974 563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:02.733987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:47813)
0812 11:15:02.734658 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:02.734756 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":298,"threads_started":1}
I20260812 11:15:03.206333 565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:03.205488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:36447)
0812 11:15:03.206006 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:03.206096 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":220,"threads_started":1}
I20260812 11:15:03.690408 566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:03.689383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:41577)
0812 11:15:03.689953 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:03.690112 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":318,"threads_started":1}
I20260812 11:15:03.736954 568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:03.736089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:56905)
0812 11:15:03.736645 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:03.736745 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":281,"threads_started":1}
I20260812 11:15:04.208185 570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:04.207395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:57843)
0812 11:15:04.207908 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:04.207999 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":268,"threads_started":1}
I20260812 11:15:04.692222 573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:04.691421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:33379)
0812 11:15:04.691924 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:04.692023 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":261,"threads_started":1}
I20260812 11:15:04.738865 576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:04.737935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:51225)
0812 11:15:04.738512 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:04.738660 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":276,"threads_started":1}
I20260812 11:15:05.210017 577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:05.209215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:39141)
0812 11:15:05.209736 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:05.209829 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":235,"threads_started":1}
I20260812 11:15:05.694159 578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:05.693341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:35031)
0812 11:15:05.693882 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:05.693980 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":291,"threads_started":1}
I20260812 11:15:05.740734 579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:05.739924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:45829)
0812 11:15:05.740410 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:05.740504 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":266,"threads_started":1}
I20260812 11:15:06.211941 580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:06.211112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:36127)
0812 11:15:06.211673 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:06.211768 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":268,"threads_started":1}
I20260812 11:15:06.696158 581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:06.695259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:48459)
0812 11:15:06.695855 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:06.695970 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":333,"threads_started":1}
I20260812 11:15:06.742641 584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:06.741761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:37965)
0812 11:15:06.742293 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:06.742438 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":267,"threads_started":1}
I20260812 11:15:07.213861 588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:07.213057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:52851)
0812 11:15:07.213545 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:07.213667 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":268,"threads_started":1}
I20260812 11:15:07.698230 589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:07.697368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:42155)
0812 11:15:07.697943 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:07.698036 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":309,"threads_started":1}
I20260812 11:15:07.744392 590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:07.743630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:60711)
0812 11:15:07.744109 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:07.744198 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":267,"threads_started":1}
I20260812 11:15:08.215636 591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:08.214890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:38421)
0812 11:15:08.215377 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:08.215468 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":249,"threads_started":1}
I20260812 11:15:08.700037 596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:08.699288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:33961)
0812 11:15:08.699755 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:08.699848 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":230,"threads_started":1}
I20260812 11:15:08.746295 598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:08.745452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:51663)
0812 11:15:08.745975 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:08.746082 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":269,"threads_started":1}
I20260812 11:15:09.217609 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:09.216699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:38947)
0812 11:15:09.217248 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:09.217378 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":237,"threads_started":1}
I20260812 11:15:09.702069 601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:09.701190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:58167)
0812 11:15:09.701754 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:09.701886 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":253,"threads_started":1}
I20260812 11:15:09.747951 603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:09.747191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:57855)
0812 11:15:09.747671 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:09.747766 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":225,"threads_started":1}
I20260812 11:15:10.219794 604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:10.218872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:41765)
0812 11:15:10.219489 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:10.219599 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":368,"threads_started":1}
I20260812 11:15:10.704018 605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:10.703149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:43349)
0812 11:15:10.703720 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:10.703814 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":287,"threads_started":1}
I20260812 11:15:10.749956 607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:10.749133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:58279)
0812 11:15:10.749669 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:10.749774 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":286,"threads_started":1}
I20260812 11:15:11.221870 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:11.221024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.66:60843)
0812 11:15:11.221577 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:11.221683 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":319,"threads_started":1}
I20260812 11:15:11.685303 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 32273
I20260812 11:15:11.706259 611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:11.705271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.67:44689)
0812 11:15:11.705871 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:11.706018 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":305,"threads_started":1}
I20260812 11:15:11.711633 610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:11.686481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32800 (local address 127.4.26.65:33263)
0812 11:15:11.687190 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:11.687211 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:11.687432 (+ 221us) server_negotiation.cc:407] Connection header received
0812 11:15:11.689639 (+ 2207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:11.689652 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:11.690113 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:11.690437 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:11.692085 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:11.693515 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:11.694860 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:11.695606 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:11.695751 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:11.704588 (+ 8837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:11.704599 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:11.704618 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:11.704674 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:11.708064 (+ 3390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:11.708880 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:11.708889 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:11.708897 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:11.709115 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:11.709573 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:11.709577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:11.709579 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:11.710181 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:11.710420 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:11.710858 (+ 438us) server_negotiation.cc:299] Negotiation successful
0812 11:15:11.711300 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":330,"threads_started":1}
I20260812 11:15:11.713107 32543 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:11.799953 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 32273
I20260812 11:15:11.800081 614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:11.798927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:41095 (local address 127.4.26.65:55663)
0812 11:15:11.799542 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:11.799799 (+ 257us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.126:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":283,"threads_started":1}
I20260812 11:15:11.827023 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 32553
I20260812 11:15:11.846369 615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:11.827986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34746 (local address 127.4.26.66:43463)
0812 11:15:11.828531 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:11.828547 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:11.828591 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:15:11.830346 (+ 1755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:11.830359 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:11.830838 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:11.831181 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:11.833045 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:11.834568 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:11.835960 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:11.836702 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:11.836852 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:11.839489 (+ 2637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:11.839497 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:11.839527 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:11.839574 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:11.842707 (+ 3133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:11.843486 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:11.843494 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:11.843502 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:11.843699 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:11.844080 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:11.844084 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:11.844086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:11.844775 (+ 689us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:11.845042 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:11.845599 (+ 557us) server_negotiation.cc:299] Negotiation successful
0812 11:15:11.846067 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":258,"threads_started":1}
I20260812 11:15:11.847867 301 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:11.932364 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 32553
I20260812 11:15:11.961912 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 313
I20260812 11:15:11.980907 621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:11.963004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49752 (local address 127.4.26.67:40831)
0812 11:15:11.963668 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:11.963682 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:11.963726 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:15:11.965480 (+ 1754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:11.965491 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:11.965953 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:11.966261 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:11.967645 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:11.968934 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:11.970333 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:11.971031 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:11.971192 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:11.973952 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:11.973961 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:11.973982 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:11.974030 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:11.977075 (+ 3045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:11.978004 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:11.978013 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:11.978021 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:11.978244 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:11.978728 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:11.978733 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:11.978735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:11.979426 (+ 691us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:11.979705 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:11.980212 (+ 507us) server_negotiation.cc:299] Negotiation successful
0812 11:15:11.980591 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":334,"threads_started":1}
I20260812 11:15:11.982404 522 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:12.067500 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 313
2026-08-12T11:15:12Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65212 ms)
[----------] 30 tests from SecurityITest (314398 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:15:12 dist-test-slave-rmhg krb5kdc[626](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:15:12 dist-test-slave-rmhg krb5kdc[626](info): set up 2 sockets
Aug 12 11:15:12 dist-test-slave-rmhg krb5kdc[626](info): commencing operation
krb5kdc: starting...
W20260812 11:15:13.357506 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.241s user 0.002s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:15:13 dist-test-slave-rmhg krb5kdc[626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:15:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:15:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:15:13.678623 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:44263
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:44263
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:14.044497 648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:14.044847 648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:14.044963 648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:14.052546 648 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:15:14.052695 648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:14.052745 648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:14.052825 648 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:15:14.052891 648 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:15:14.063611 648 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:44263
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:44263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:14.065074 648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:14.066547 648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:14.079581 661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:14.079677 658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:14.079648 659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:14.080467 648 server_base.cc:1034] running on GCE node
I20260812 11:15:14.081393 648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:14.082968 648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:14.084208 648 hybrid_clock.cc:648] HybridClock initialized: now 1786533314084142 us; error 55 us; skew 500 ppm
I20260812 11:15:14.084576 648 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:14 dist-test-slave-rmhg krb5kdc[626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533314, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:14.088073 648 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:15:14.089922 648 webserver.cc:460] Webserver started at http://127.4.26.126:34607/ using document root <none> and password file <none>
I20260812 11:15:14.090687 648 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:14.090801 648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:14.091082 648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:14.094492 648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "f98d8b2e49d34bf380f56073bbe3a012"
format_stamp: "Formatted at 2026-08-12 11:15:14 on dist-test-slave-rmhg"
server_key: "d64aa90fc70309f0ba7d02e032154798"
server_key_iv: "74aad7955186fc5ab2945019c125201a"
server_key_version: "encryptionkey@0"
I20260812 11:15:14.095383 648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "f98d8b2e49d34bf380f56073bbe3a012"
format_stamp: "Formatted at 2026-08-12 11:15:14 on dist-test-slave-rmhg"
server_key: "d64aa90fc70309f0ba7d02e032154798"
server_key_iv: "74aad7955186fc5ab2945019c125201a"
server_key_version: "encryptionkey@0"
I20260812 11:15:14.101626 648 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:15:14.105906 678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:14.107614 648 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:15:14.107805 648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "f98d8b2e49d34bf380f56073bbe3a012"
format_stamp: "Formatted at 2026-08-12 11:15:14 on dist-test-slave-rmhg"
server_key: "d64aa90fc70309f0ba7d02e032154798"
server_key_iv: "74aad7955186fc5ab2945019c125201a"
server_key_version: "encryptionkey@0"
I20260812 11:15:14.108036 648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:14.128966 648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:14.133589 648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:14.133862 648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:14.153311 648 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:44263
I20260812 11:15:14.153333 776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:44263 every 8 connection(s)
I20260812 11:15:14.154881 648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:15:14.159168 778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:14.161302 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 648
I20260812 11:15:14.161552 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:15:14.162420 4201 external_mini_cluster.cc:1428] Setting key fc608325ed2923da905728ca183f6db2
I20260812 11:15:14.173183 778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012: Bootstrap starting.
I20260812 11:15:14.177348 778 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:14.178764 778 log.cc:824] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:15:14 dist-test-slave-rmhg krb5kdc[626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:15:14.181928 778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012: No bootstrap required, opened a new log
I20260812 11:15:14.188016 784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:14.164823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40060 (local address 127.4.26.126:44263)
0812 11:15:14.165780 (+ 957us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:14.165793 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:14.165842 (+ 49us) server_negotiation.cc:407] Connection header received
0812 11:15:14.167660 (+ 1818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:14.167687 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:14.168167 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:14.168546 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:14.170591 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:14.172040 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:14.174077 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:14.174831 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:14.175009 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:14.180218 (+ 5209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:14.180227 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:14.180246 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:14.180288 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:14.183443 (+ 3155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:14.184250 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:14.184261 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:14.184268 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:14.184471 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:14.184903 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:14.184906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:14.184909 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:14.185580 (+ 671us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:14.185891 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:14.186400 (+ 509us) server_negotiation.cc:299] Negotiation successful
0812 11:15:14.186879 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":418,"threads_started":1}
I20260812 11:15:14.190122 778 raft_consensus.cc:348] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f98d8b2e49d34bf380f56073bbe3a012" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44263 } }
I20260812 11:15:14.190518 778 raft_consensus.cc:374] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:14.190622 778 raft_consensus.cc:729] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f98d8b2e49d34bf380f56073bbe3a012, State: Initialized, Role: FOLLOWER
I20260812 11:15:14.191320 778 consensus_queue.cc:260] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f98d8b2e49d34bf380f56073bbe3a012" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44263 } }
I20260812 11:15:14.191557 778 raft_consensus.cc:388] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:15:14.191660 778 raft_consensus.cc:482] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:15:14.191781 778 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:14.194350 778 raft_consensus.cc:504] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f98d8b2e49d34bf380f56073bbe3a012" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44263 } }
I20260812 11:15:14.194868 778 leader_election.cc:302] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f98d8b2e49d34bf380f56073bbe3a012; no voters:
I20260812 11:15:14.195461 778 leader_election.cc:288] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:15:14.195688 787 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:14.196345 787 raft_consensus.cc:686] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [term 1 LEADER]: Becoming Leader. State: Replica: f98d8b2e49d34bf380f56073bbe3a012, State: Running, Role: LEADER
I20260812 11:15:14.196933 787 consensus_queue.cc:237] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f98d8b2e49d34bf380f56073bbe3a012" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44263 } }
I20260812 11:15:14.197698 778 sys_catalog.cc:564] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:15:14.200071 789 sys_catalog.cc:455] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f98d8b2e49d34bf380f56073bbe3a012" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f98d8b2e49d34bf380f56073bbe3a012" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44263 } } }
I20260812 11:15:14.200636 789 sys_catalog.cc:458] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:14.200206 790 sys_catalog.cc:455] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f98d8b2e49d34bf380f56073bbe3a012. Latest consensus state: current_term: 1 leader_uuid: "f98d8b2e49d34bf380f56073bbe3a012" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f98d8b2e49d34bf380f56073bbe3a012" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44263 } } }
I20260812 11:15:14.201233 790 sys_catalog.cc:458] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:14.203035 800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:15:14.208550 800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:15:14.218503 800 catalog_manager.cc:1347] Generated new cluster ID: 1ad6021bcf1f484cb7738ee1af0a523e
I20260812 11:15:14.218647 800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:15:14.249496 800 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:15:14.251509 800 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:15:14.266541 800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012: Generated new TSK 0
I20260812 11:15:14.267751 800 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:15:14.342504 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:44263
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:14.697300 820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:14.697726 820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:14.697913 820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:14.706135 820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:14.706286 820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:14.706432 820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:15:14.716995 820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:44263
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:14.718464 820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:14.719965 820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:14.733650 831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:14.733693 835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:14.733911 838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:14.734380 820 server_base.cc:1034] running on GCE node
I20260812 11:15:14.735001 820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:14.735940 820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:14.737182 820 hybrid_clock.cc:648] HybridClock initialized: now 1786533314737095 us; error 37 us; skew 500 ppm
I20260812 11:15:14.737510 820 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:14 dist-test-slave-rmhg krb5kdc[626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533314, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:14.740576 820 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:15:14.742132 820 webserver.cc:460] Webserver started at http://127.4.26.65:35121/ using document root <none> and password file <none>
I20260812 11:15:14.742825 820 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:14.742942 820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:14.743264 820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:14.746342 820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "b9e1df38932f472da02119f30790eace"
format_stamp: "Formatted at 2026-08-12 11:15:14 on dist-test-slave-rmhg"
server_key: "d8717bc760ac10890afe10007d4fd5a7"
server_key_iv: "de171830ecf6f80e9f2b682eed4442e1"
server_key_version: "encryptionkey@0"
I20260812 11:15:14.747144 820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "b9e1df38932f472da02119f30790eace"
format_stamp: "Formatted at 2026-08-12 11:15:14 on dist-test-slave-rmhg"
server_key: "d8717bc760ac10890afe10007d4fd5a7"
server_key_iv: "de171830ecf6f80e9f2b682eed4442e1"
server_key_version: "encryptionkey@0"
I20260812 11:15:14.752390 820 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260812 11:15:14.755956 855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:14.757485 820 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:15:14.757643 820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "b9e1df38932f472da02119f30790eace"
format_stamp: "Formatted at 2026-08-12 11:15:14 on dist-test-slave-rmhg"
server_key: "d8717bc760ac10890afe10007d4fd5a7"
server_key_iv: "de171830ecf6f80e9f2b682eed4442e1"
server_key_version: "encryptionkey@0"
I20260812 11:15:14.757831 820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:14.775988 820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:14.780632 820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:14.780921 820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:14.782007 820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:14.783450 820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:14.783525 820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:14.783666 820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:14.783718 820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:14.814965 820 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:33829
I20260812 11:15:14.815016 1036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:33829 every 8 connection(s)
I20260812 11:15:14.816355 820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:15:14.826810 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 820
I20260812 11:15:14.827105 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:15:14.827816 4201 external_mini_cluster.cc:1428] Setting key f25b51ed4a863aa320d43a2a5765ff8d
Aug 12 11:15:14 dist-test-slave-rmhg krb5kdc[626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533314, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:15:14.838677 1040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:14.819145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:47943 (local address 127.4.26.126:44263)
0812 11:15:14.819627 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:14.819634 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:14.820808 (+ 1174us) server_negotiation.cc:407] Connection header received
0812 11:15:14.822858 (+ 2050us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:14.822863 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:14.822963 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:14.823067 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:14.824924 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:14.825728 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:14.827769 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:14.828238 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:14.828373 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:14.832321 (+ 3948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:14.832326 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:14.832330 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:14.832370 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:14.835189 (+ 2819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:14.836116 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:14.836122 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:14.836124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:14.836265 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:14.836742 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:14.836746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:14.836748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:14.837043 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:14.837220 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:14.838025 (+ 805us) server_negotiation.cc:299] Negotiation successful
0812 11:15:14.838290 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":209,"threads_started":1}
I20260812 11:15:14.839761 1043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:14.819754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:44263 (local address 127.4.26.65:47943)
0812 11:15:14.820607 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:14.820665 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:14.822515 (+ 1850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:14.823381 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:14.823391 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:14.824034 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:14.824710 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:14.824733 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:14.825948 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:14.825953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:14.827576 (+ 1623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:14.827595 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:14.828520 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:14.828541 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:14.828787 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:14.829589 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:15:14.829624 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:14.832037 (+ 2413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:14.835405 (+ 3368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:14.835416 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:14.835434 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:14.835963 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:14.836391 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:14.836394 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:14.836397 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:14.836616 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:14.837226 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:14.837236 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:14.837619 (+ 383us) client_negotiation.cc:769] Sending connection context
0812 11:15:14.837901 (+ 282us) client_negotiation.cc:240] Negotiation successful
0812 11:15:14.838545 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":328,"threads_started":1}
I20260812 11:15:14.841650 1038 heartbeater.cc:347] Connected to a master server at 127.4.26.126:44263
I20260812 11:15:14.842010 1038 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:14.842830 1038 heartbeater.cc:511] Master 127.4.26.126:44263 requested a full tablet report, sending...
I20260812 11:15:14.845448 716 ts_manager.cc:194] Registered new tserver with Master: b9e1df38932f472da02119f30790eace (127.4.26.65:33829)
I20260812 11:15:14.847040 716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:47943
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:15:14.899133 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:44263
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:15.249027 1048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:15.249400 1048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:15.249521 1048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:15.257470 1048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:15.257601 1048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:15.257727 1048 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:15:15.268373 1048 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:44263
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:15.269744 1048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:15.271039 1048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:15.284639 1059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:15.284615 1065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:15.284672 1060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:15.285692 1048 server_base.cc:1034] running on GCE node
I20260812 11:15:15.286345 1048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:15.287352 1048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:15.288571 1048 hybrid_clock.cc:648] HybridClock initialized: now 1786533315288528 us; error 40 us; skew 500 ppm
I20260812 11:15:15.288946 1048 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:15 dist-test-slave-rmhg krb5kdc[626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533315, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:15.292310 1048 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:15:15.293985 1048 webserver.cc:460] Webserver started at http://127.4.26.66:33887/ using document root <none> and password file <none>
I20260812 11:15:15.294767 1048 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:15.294898 1048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:15.295219 1048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:15.298722 1048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "14e09f298b4540978af95237e67add2d"
format_stamp: "Formatted at 2026-08-12 11:15:15 on dist-test-slave-rmhg"
server_key: "f064b53877fa9a69251cce362d0a4f93"
server_key_iv: "d89d9243d3955acc51953d6b29886bee"
server_key_version: "encryptionkey@0"
I20260812 11:15:15.299600 1048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "14e09f298b4540978af95237e67add2d"
format_stamp: "Formatted at 2026-08-12 11:15:15 on dist-test-slave-rmhg"
server_key: "f064b53877fa9a69251cce362d0a4f93"
server_key_iv: "d89d9243d3955acc51953d6b29886bee"
server_key_version: "encryptionkey@0"
I20260812 11:15:15.305420 1048 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:15:15.309433 1074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:15.310952 1048 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:15:15.311136 1048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "14e09f298b4540978af95237e67add2d"
format_stamp: "Formatted at 2026-08-12 11:15:15 on dist-test-slave-rmhg"
server_key: "f064b53877fa9a69251cce362d0a4f93"
server_key_iv: "d89d9243d3955acc51953d6b29886bee"
server_key_version: "encryptionkey@0"
I20260812 11:15:15.311364 1048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:15.341012 1048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:15.345621 1048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:15.345921 1048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:15.346966 1048 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:15.348752 1048 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:15.348857 1048 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:15.348994 1048 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:15.349059 1048 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:15.383507 1048 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:37667
I20260812 11:15:15.383580 1279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:37667 every 8 connection(s)
I20260812 11:15:15.384850 1048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:15:15.391234 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 1048
I20260812 11:15:15.391413 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:15:15.391863 4201 external_mini_cluster.cc:1428] Setting key da4e9f125dd0b0430f36e41c072065b9
Aug 12 11:15:15 dist-test-slave-rmhg krb5kdc[626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533315, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:15:15.408780 1286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:15.388176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:53635 (local address 127.4.26.126:44263)
0812 11:15:15.388756 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:15.388762 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:15.389990 (+ 1228us) server_negotiation.cc:407] Connection header received
0812 11:15:15.392251 (+ 2261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:15.392257 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:15.392373 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:15.392525 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:15.394806 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:15.395834 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:15.397581 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:15.398191 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:15.398314 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:15.401969 (+ 3655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:15.401976 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:15.401980 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:15.402023 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:15.405362 (+ 3339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:15.406177 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:15.406183 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:15.406186 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:15.406362 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:15.406797 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:15.406801 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:15.406804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:15.407146 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:15.407300 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:15.408306 (+ 1006us) server_negotiation.cc:299] Negotiation successful
0812 11:15:15.408498 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":289,"threads_started":1}
I20260812 11:15:15.410323 1288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:15.388730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:44263 (local address 127.4.26.66:53635)
0812 11:15:15.389692 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:15.389754 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:15.391858 (+ 2104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:15.392868 (+ 1010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:15.392878 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:15.393717 (+ 839us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:15.394603 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:15.394628 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:15.396026 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:15.396030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:15.397438 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:15.397452 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:15.398396 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:15.398401 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:15.398610 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:15.399323 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:15:15.399347 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:15.401688 (+ 2341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:15.405524 (+ 3836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:15.405533 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:15.405550 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:15.406037 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:15.406465 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:15.406468 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:15.406470 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:15.406685 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:15.407312 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:15.407319 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:15.407791 (+ 472us) client_negotiation.cc:769] Sending connection context
0812 11:15:15.408198 (+ 407us) client_negotiation.cc:240] Negotiation successful
0812 11:15:15.408814 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":392,"threads_started":1}
I20260812 11:15:15.412081 1281 heartbeater.cc:347] Connected to a master server at 127.4.26.126:44263
I20260812 11:15:15.412441 1281 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:15.413357 1281 heartbeater.cc:511] Master 127.4.26.126:44263 requested a full tablet report, sending...
I20260812 11:15:15.414958 716 ts_manager.cc:194] Registered new tserver with Master: 14e09f298b4540978af95237e67add2d (127.4.26.66:37667)
I20260812 11:15:15.415952 716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:53635
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:15:15.462692 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:44263
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40065
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:15.813123 1292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:15.813480 1292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:15.813629 1292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:15.821609 1292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:15.821748 1292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:15.821913 1292 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:15:15.832288 1292 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40065
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:44263
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:15.833813 1292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:15.835194 1292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:15.849316 1304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:15.849244 1307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:15.849440 1310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:15.850114 1292 server_base.cc:1034] running on GCE node
I20260812 11:15:15.850580 1038 heartbeater.cc:503] Master 127.4.26.126:44263 was elected leader, sending a full tablet report...
I20260812 11:15:15.850785 1292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:15.851953 1292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:15.853248 1292 hybrid_clock.cc:648] HybridClock initialized: now 1786533315853163 us; error 67 us; skew 500 ppm
I20260812 11:15:15.853559 1292 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:15 dist-test-slave-rmhg krb5kdc[626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533315, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:15.856739 1292 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:15:15.858280 1292 webserver.cc:460] Webserver started at http://127.4.26.67:40365/ using document root <none> and password file <none>
I20260812 11:15:15.858963 1292 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:15.859071 1292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:15.859355 1292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:15.862625 1292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "acd68959d08f41ee9b293bc13f355746"
format_stamp: "Formatted at 2026-08-12 11:15:15 on dist-test-slave-rmhg"
server_key: "b41259982a85a949fbe2433b54ea40de"
server_key_iv: "36be385d4aa7d4083817e04c132d255c"
server_key_version: "encryptionkey@0"
I20260812 11:15:15.863466 1292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "acd68959d08f41ee9b293bc13f355746"
format_stamp: "Formatted at 2026-08-12 11:15:15 on dist-test-slave-rmhg"
server_key: "b41259982a85a949fbe2433b54ea40de"
server_key_iv: "36be385d4aa7d4083817e04c132d255c"
server_key_version: "encryptionkey@0"
I20260812 11:15:15.869074 1292 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260812 11:15:15.872836 1321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:15.874347 1292 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:15:15.874511 1292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "acd68959d08f41ee9b293bc13f355746"
format_stamp: "Formatted at 2026-08-12 11:15:15 on dist-test-slave-rmhg"
server_key: "b41259982a85a949fbe2433b54ea40de"
server_key_iv: "36be385d4aa7d4083817e04c132d255c"
server_key_version: "encryptionkey@0"
I20260812 11:15:15.874712 1292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:15.885936 1292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:15.890348 1292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:15.890615 1292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:15.891543 1292 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:15.892864 1292 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:15.892940 1292 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:15.893043 1292 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:15.893087 1292 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:15.925876 1292 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:33239
I20260812 11:15:15.925938 1509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:33239 every 8 connection(s)
I20260812 11:15:15.927205 1292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:15:15.934734 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 1292
I20260812 11:15:15.934922 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:15:15.935345 4201 external_mini_cluster.cc:1428] Setting key 9e3873b200af8363d1c869117ec06af4
Aug 12 11:15:15 dist-test-slave-rmhg krb5kdc[626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533315, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:15:15.948020 1517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:15.929808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:53683 (local address 127.4.26.126:44263)
0812 11:15:15.930271 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:15.930278 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:15.931302 (+ 1024us) server_negotiation.cc:407] Connection header received
0812 11:15:15.933107 (+ 1805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:15.933112 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:15.933236 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:15.933330 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:15.934904 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:15.935770 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:15.937987 (+ 2217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:15.938532 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:15.938640 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:15.942272 (+ 3632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:15.942279 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:15.942282 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:15.942320 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:15.945049 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:15.945863 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:15.945867 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:15.945869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:15.945995 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:15.946381 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:15.946384 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:15.946386 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:15.946676 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:15.946801 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:15.947532 (+ 731us) server_negotiation.cc:299] Negotiation successful
0812 11:15:15.947728 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":206,"threads_started":1}
I20260812 11:15:15.949070 1519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:15.930410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:44263 (local address 127.4.26.67:53683)
0812 11:15:15.931127 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:15.931176 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:15.932848 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:15.933561 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:15.933570 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:15.934134 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:15.934722 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:15.934740 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:15.935933 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:15.935938 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:15.937793 (+ 1855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:15.937806 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:15.938749 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:15.938756 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:15.938967 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:15.939613 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:15:15.939637 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:15.942006 (+ 2369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:15.945242 (+ 3236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:15.945251 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:15.945267 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:15.945751 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:15.946076 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:15.946079 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:15.946081 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:15.946288 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:15.946783 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:15.946790 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:15.947172 (+ 382us) client_negotiation.cc:769] Sending connection context
0812 11:15:15.947413 (+ 241us) client_negotiation.cc:240] Negotiation successful
0812 11:15:15.947842 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":281,"threads_started":1}
I20260812 11:15:15.950503 1513 heartbeater.cc:347] Connected to a master server at 127.4.26.126:44263
I20260812 11:15:15.950874 1513 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:15.951609 1513 heartbeater.cc:511] Master 127.4.26.126:44263 requested a full tablet report, sending...
I20260812 11:15:15.952958 716 ts_manager.cc:194] Registered new tserver with Master: acd68959d08f41ee9b293bc13f355746 (127.4.26.67:33239)
I20260812 11:15:15.953811 716 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:53683
I20260812 11:15:15.963900 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:15:15.981912 1517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:15.968668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40064 (local address 127.4.26.126:44263)
0812 11:15:15.968848 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:15.968852 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:15.969369 (+ 517us) server_negotiation.cc:407] Connection header received
0812 11:15:15.969540 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:15.969544 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:15.969629 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:15.969727 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:15.971335 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:15.972099 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:15.973595 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:15.974030 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:15.974123 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:15.976447 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:15.976452 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:15.976455 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:15.976492 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:15.979357 (+ 2865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:15.980096 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:15.980100 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:15.980102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:15.980231 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:15.980528 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:15.980530 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:15.980532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:15.980877 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:15.981058 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:15.981467 (+ 409us) server_negotiation.cc:299] Negotiation successful
0812 11:15:15.981677 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:15:15.986021 716 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40064:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:15:15.992964 716 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:15:16.018169 1541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:16.006676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45668 (local address 127.4.26.66:37667)
0812 11:15:16.009204 (+ 2528us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:16.009213 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:16.009241 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:15:16.009346 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:16.009354 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:16.009612 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:16.010201 (+ 589us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:16.010709 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.012103 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.015327 (+ 3224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.016886 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.017024 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:16.017273 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:16.017612 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 11:15:16.017813 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2355,"thread_start_us":2227,"threads_started":1}
I20260812 11:15:16.018297 1538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:16.006048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:37667 (local address 127.0.0.1:45668)
0812 11:15:16.007159 (+ 1111us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:16.007209 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:16.007389 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:16.009864 (+ 2475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:16.009874 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:16.009919 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:16.010529 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:16.010544 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.012242 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.012248 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:16.015108 (+ 2860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:16.015118 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.017103 (+ 1985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.017110 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:16.017320 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:16.017379 (+ 59us) client_negotiation.cc:769] Sending connection context
0812 11:15:16.017556 (+ 177us) client_negotiation.cc:240] Negotiation successful
0812 11:15:16.017779 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":858,"mutex_wait_us":191,"spinlock_wait_cycles":4992,"thread_start_us":2048,"threads_started":1}
I20260812 11:15:16.018579 1542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:16.007194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33838 (local address 127.4.26.67:33239)
0812 11:15:16.008761 (+ 1567us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:16.008772 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:16.009210 (+ 438us) server_negotiation.cc:407] Connection header received
0812 11:15:16.009343 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:16.009349 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:16.009564 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:16.009743 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:16.011315 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.012894 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.015350 (+ 2456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.016886 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.017024 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:16.017313 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:16.018046 (+ 733us) server_negotiation.cc:299] Negotiation successful
0812 11:15:16.018223 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1372,"thread_start_us":1922,"threads_started":1}
I20260812 11:15:16.019150 1545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:16.006403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:33239 (local address 127.0.0.1:33838)
0812 11:15:16.008882 (+ 2479us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:16.008905 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:16.009040 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:16.009780 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:16.009787 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:16.009817 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:16.011078 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:16.011091 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.013017 (+ 1926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.013022 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:16.015098 (+ 2076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:16.015115 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.017451 (+ 2336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.017456 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:16.017622 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:16.017653 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 11:15:16.017741 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 11:15:16.017874 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2350,"mutex_wait_us":101,"spinlock_wait_cycles":5888,"thread_start_us":366,"threads_started":1}
I20260812 11:15:16.019532 1546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:16.008575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49482 (local address 127.4.26.65:33829)
0812 11:15:16.010891 (+ 2316us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:16.010899 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:16.010927 (+ 28us) server_negotiation.cc:407] Connection header received
0812 11:15:16.011023 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:16.011030 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:16.011292 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:16.011542 (+ 250us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:16.012408 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.014035 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.016435 (+ 2400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.017643 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.017758 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:16.017982 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:16.019002 (+ 1020us) server_negotiation.cc:299] Negotiation successful
0812 11:15:16.019194 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2161,"thread_start_us":1985,"threads_started":1}
I20260812 11:15:16.019991 1533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:16.008294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33829 (local address 127.0.0.1:49482)
0812 11:15:16.009058 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:16.009073 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:16.009202 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:16.011859 (+ 2657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:16.011864 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:16.011890 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:16.012231 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:16.012244 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.014222 (+ 1978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.014227 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:16.016247 (+ 2020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:16.016263 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.018125 (+ 1862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.018131 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:16.018318 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:16.018349 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 11:15:16.018437 (+ 88us) client_negotiation.cc:240] Negotiation successful
0812 11:15:16.018559 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"mutex_wait_us":67,"thread_start_us":301,"threads_started":1}
I20260812 11:15:16.022866 1156 tablet_service.cc:1467] Processing CreateTablet for tablet 2c90c5a485df4980868c9aac32033d98 (DEFAULT_TABLE table=test-table [id=8379fd10d5d6492e9b2e61f4380d8b74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:16.023284 1396 tablet_service.cc:1467] Processing CreateTablet for tablet 2c90c5a485df4980868c9aac32033d98 (DEFAULT_TABLE table=test-table [id=8379fd10d5d6492e9b2e61f4380d8b74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:16.023757 923 tablet_service.cc:1467] Processing CreateTablet for tablet 2c90c5a485df4980868c9aac32033d98 (DEFAULT_TABLE table=test-table [id=8379fd10d5d6492e9b2e61f4380d8b74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:16.024631 1156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c90c5a485df4980868c9aac32033d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:16.024667 1396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c90c5a485df4980868c9aac32033d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:16.025199 923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c90c5a485df4980868c9aac32033d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:16.036322 1548 tablet_bootstrap.cc:492] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746: Bootstrap starting.
I20260812 11:15:16.039775 1549 tablet_bootstrap.cc:492] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d: Bootstrap starting.
I20260812 11:15:16.041455 1548 tablet_bootstrap.cc:654] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:16.042918 1548 log.cc:824] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:16.043337 1549 tablet_bootstrap.cc:654] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:16.044497 1550 tablet_bootstrap.cc:492] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace: Bootstrap starting.
I20260812 11:15:16.044677 1549 log.cc:824] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:16.046525 1548 tablet_bootstrap.cc:492] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746: No bootstrap required, opened a new log
I20260812 11:15:16.046898 1548 ts_tablet_manager.cc:1397] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260812 11:15:16.047945 1549 tablet_bootstrap.cc:492] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d: No bootstrap required, opened a new log
I20260812 11:15:16.048245 1549 ts_tablet_manager.cc:1397] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.002s
I20260812 11:15:16.048599 1550 tablet_bootstrap.cc:654] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:16.049649 1550 log.cc:824] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:16.052237 1550 tablet_bootstrap.cc:492] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace: No bootstrap required, opened a new log
I20260812 11:15:16.052498 1550 ts_tablet_manager.cc:1397] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260812 11:15:16.058135 1548 raft_consensus.cc:348] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e09f298b4540978af95237e67add2d" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37667 } } peers { permanent_uuid: "acd68959d08f41ee9b293bc13f355746" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33239 } } peers { permanent_uuid: "b9e1df38932f472da02119f30790eace" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33829 } }
I20260812 11:15:16.058539 1549 raft_consensus.cc:348] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e09f298b4540978af95237e67add2d" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37667 } } peers { permanent_uuid: "acd68959d08f41ee9b293bc13f355746" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33239 } } peers { permanent_uuid: "b9e1df38932f472da02119f30790eace" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33829 } }
I20260812 11:15:16.058817 1548 raft_consensus.cc:374] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:16.058969 1548 raft_consensus.cc:729] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acd68959d08f41ee9b293bc13f355746, State: Initialized, Role: FOLLOWER
I20260812 11:15:16.059003 1549 raft_consensus.cc:374] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:16.059095 1549 raft_consensus.cc:729] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14e09f298b4540978af95237e67add2d, State: Initialized, Role: FOLLOWER
I20260812 11:15:16.059696 1548 consensus_queue.cc:260] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e09f298b4540978af95237e67add2d" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37667 } } peers { permanent_uuid: "acd68959d08f41ee9b293bc13f355746" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33239 } } peers { permanent_uuid: "b9e1df38932f472da02119f30790eace" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33829 } }
I20260812 11:15:16.059747 1549 consensus_queue.cc:260] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e09f298b4540978af95237e67add2d" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37667 } } peers { permanent_uuid: "acd68959d08f41ee9b293bc13f355746" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33239 } } peers { permanent_uuid: "b9e1df38932f472da02119f30790eace" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33829 } }
I20260812 11:15:16.059998 1550 raft_consensus.cc:348] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e09f298b4540978af95237e67add2d" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37667 } } peers { permanent_uuid: "acd68959d08f41ee9b293bc13f355746" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33239 } } peers { permanent_uuid: "b9e1df38932f472da02119f30790eace" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33829 } }
I20260812 11:15:16.060482 1550 raft_consensus.cc:374] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:16.060633 1550 raft_consensus.cc:729] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e1df38932f472da02119f30790eace, State: Initialized, Role: FOLLOWER
I20260812 11:15:16.061401 1281 heartbeater.cc:503] Master 127.4.26.126:44263 was elected leader, sending a full tablet report...
I20260812 11:15:16.061439 1513 heartbeater.cc:503] Master 127.4.26.126:44263 was elected leader, sending a full tablet report...
I20260812 11:15:16.061982 1549 ts_tablet_manager.cc:1428] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d: Time spent starting tablet: real 0.014s user 0.012s sys 0.003s
I20260812 11:15:16.061910 1550 consensus_queue.cc:260] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e09f298b4540978af95237e67add2d" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37667 } } peers { permanent_uuid: "acd68959d08f41ee9b293bc13f355746" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33239 } } peers { permanent_uuid: "b9e1df38932f472da02119f30790eace" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33829 } }
I20260812 11:15:16.062717 1548 ts_tablet_manager.cc:1428] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746: Time spent starting tablet: real 0.016s user 0.013s sys 0.000s
I20260812 11:15:16.064504 1550 ts_tablet_manager.cc:1428] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
W20260812 11:15:16.068722 1039 tablet.cc:2369] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:15:16.136965 1282 tablet.cc:2369] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:15:16.154282 1562 raft_consensus.cc:482] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:15:16.154655 1562 raft_consensus.cc:504] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e09f298b4540978af95237e67add2d" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37667 } } peers { permanent_uuid: "acd68959d08f41ee9b293bc13f355746" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33239 } } peers { permanent_uuid: "b9e1df38932f472da02119f30790eace" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33829 } }
I20260812 11:15:16.156831 1562 leader_election.cc:288] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acd68959d08f41ee9b293bc13f355746 (127.4.26.67:33239), b9e1df38932f472da02119f30790eace (127.4.26.65:33829)
I20260812 11:15:16.164672 1542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:16.157542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:46925 (local address 127.4.26.67:33239)
0812 11:15:16.157806 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:16.157813 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:16.158285 (+ 472us) server_negotiation.cc:407] Connection header received
0812 11:15:16.158632 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:16.158637 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:16.158727 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:16.158819 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:16.159416 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.160284 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.162793 (+ 2509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.163708 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.163833 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:16.163940 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:16.164260 (+ 320us) server_negotiation.cc:299] Negotiation successful
0812 11:15:16.164401 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 11:15:16.164789 1564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:16.157181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:33239 (local address 127.4.26.66:46925)
0812 11:15:16.158161 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:16.158181 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:16.158418 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:16.158851 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:16.158856 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:16.158885 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:16.159251 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:16.159262 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.160415 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.160419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:16.162572 (+ 2153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:16.162588 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.163919 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.163925 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:16.164091 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:16.164127 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:15:16.164220 (+ 93us) client_negotiation.cc:240] Negotiation successful
0812 11:15:16.164362 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":835,"mutex_wait_us":23,"thread_start_us":631,"threads_started":1}
I20260812 11:15:16.165946 1546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:16.157378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:40045 (local address 127.4.26.65:33829)
0812 11:15:16.157574 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:16.157580 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:16.158739 (+ 1159us) server_negotiation.cc:407] Connection header received
0812 11:15:16.158937 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:16.158944 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:16.159017 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:16.159066 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:16.159820 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.160928 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.163666 (+ 2738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.164793 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.164921 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:16.165015 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:16.165554 (+ 539us) server_negotiation.cc:299] Negotiation successful
0812 11:15:16.165707 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:15:16.166009 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c90c5a485df4980868c9aac32033d98" candidate_uuid: "14e09f298b4540978af95237e67add2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acd68959d08f41ee9b293bc13f355746" is_pre_election: true
I20260812 11:15:16.166620 1567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:16.157393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:33829 (local address 127.4.26.66:40045)
0812 11:15:16.158603 (+ 1210us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:16.158621 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:16.158760 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:16.159232 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:16.159235 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:16.159255 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:16.159634 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:16.159659 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.161271 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.161276 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:16.163481 (+ 2205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:16.163496 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.165186 (+ 1690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.165193 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:16.165373 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:16.165405 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 11:15:16.166112 (+ 707us) client_negotiation.cc:240] Negotiation successful
0812 11:15:16.166256 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1085,"mutex_wait_us":1,"thread_start_us":855,"threads_started":1}
I20260812 11:15:16.166610 1437 raft_consensus.cc:2454] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e09f298b4540978af95237e67add2d in term 0.
I20260812 11:15:16.167382 1075 leader_election.cc:302] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e09f298b4540978af95237e67add2d, acd68959d08f41ee9b293bc13f355746; no voters:
I20260812 11:15:16.167652 955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c90c5a485df4980868c9aac32033d98" candidate_uuid: "14e09f298b4540978af95237e67add2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e1df38932f472da02119f30790eace" is_pre_election: true
I20260812 11:15:16.167855 1562 raft_consensus.cc:2781] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:15:16.168006 1562 raft_consensus.cc:482] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:15:16.168123 1562 raft_consensus.cc:3037] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:16.168242 955 raft_consensus.cc:2454] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14e09f298b4540978af95237e67add2d in term 0.
I20260812 11:15:16.170682 1562 raft_consensus.cc:504] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e09f298b4540978af95237e67add2d" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37667 } } peers { permanent_uuid: "acd68959d08f41ee9b293bc13f355746" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33239 } } peers { permanent_uuid: "b9e1df38932f472da02119f30790eace" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33829 } }
I20260812 11:15:16.171324 1562 leader_election.cc:288] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [CANDIDATE]: Term 1 election: Requested vote from peers acd68959d08f41ee9b293bc13f355746 (127.4.26.67:33239), b9e1df38932f472da02119f30790eace (127.4.26.65:33829)
I20260812 11:15:16.171831 955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c90c5a485df4980868c9aac32033d98" candidate_uuid: "14e09f298b4540978af95237e67add2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9e1df38932f472da02119f30790eace"
I20260812 11:15:16.171838 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c90c5a485df4980868c9aac32033d98" candidate_uuid: "14e09f298b4540978af95237e67add2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acd68959d08f41ee9b293bc13f355746"
I20260812 11:15:16.172029 955 raft_consensus.cc:3037] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:16.172034 1437 raft_consensus.cc:3037] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:16.174361 1437 raft_consensus.cc:2454] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e09f298b4540978af95237e67add2d in term 1.
I20260812 11:15:16.174364 955 raft_consensus.cc:2454] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14e09f298b4540978af95237e67add2d in term 1.
I20260812 11:15:16.174847 1077 leader_election.cc:302] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14e09f298b4540978af95237e67add2d, b9e1df38932f472da02119f30790eace; no voters:
I20260812 11:15:16.175371 1562 raft_consensus.cc:2781] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:16.175855 1562 raft_consensus.cc:686] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [term 1 LEADER]: Becoming Leader. State: Replica: 14e09f298b4540978af95237e67add2d, State: Running, Role: LEADER
I20260812 11:15:16.176383 1562 consensus_queue.cc:237] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e09f298b4540978af95237e67add2d" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37667 } } peers { permanent_uuid: "acd68959d08f41ee9b293bc13f355746" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33239 } } peers { permanent_uuid: "b9e1df38932f472da02119f30790eace" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33829 } }
W20260812 11:15:16.178838 1514 tablet.cc:2369] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:15:16.181283 715 catalog_manager.cc:5495] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d reported cstate change: term changed from 0 to 1, leader changed from <none> to 14e09f298b4540978af95237e67add2d (127.4.26.66). New cstate: current_term: 1 leader_uuid: "14e09f298b4540978af95237e67add2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14e09f298b4540978af95237e67add2d" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 37667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acd68959d08f41ee9b293bc13f355746" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9e1df38932f472da02119f30790eace" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33829 } health_report { overall_health: UNKNOWN } } }
I20260812 11:15:16.211870 1541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:16.206743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45682 (local address 127.4.26.66:37667)
0812 11:15:16.206943 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:16.206948 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:16.206966 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:15:16.207080 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:16.207084 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:16.207166 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:16.207289 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:15:16.207601 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.208310 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.209736 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.210160 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.210256 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:16.210720 (+ 464us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:15:16.211291 (+ 571us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:15:16.211405 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:16.211500 (+ 95us) server_negotiation.cc:299] Negotiation successful
0812 11:15:16.211575 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:15:16.220970 955 raft_consensus.cc:1261] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace [term 1 FOLLOWER]: Refusing update from remote peer 14e09f298b4540978af95237e67add2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:15:16.220985 1437 raft_consensus.cc:1261] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746 [term 1 FOLLOWER]: Refusing update from remote peer 14e09f298b4540978af95237e67add2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:15:16.222118 1568 consensus_queue.cc:1035] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "acd68959d08f41ee9b293bc13f355746" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:15:16.222491 1562 consensus_queue.cc:1035] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9e1df38932f472da02119f30790eace" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 33829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:15:16.240162 1578 mvcc.cc:205] Tried to move back new op lower bound from 7317640463229841408 to 7317640463062716416. Current Snapshot: MvccSnapshot[applied={T|T < 7317640463229841408}]
I20260812 11:15:16.254560 715 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40064:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:15:16.254901 715 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40064:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:15:16.259172 715 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f98d8b2e49d34bf380f56073bbe3a012: Sending DeleteTablet for 3 replicas of tablet 2c90c5a485df4980868c9aac32033d98
I20260812 11:15:16.260537 1156 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c90c5a485df4980868c9aac32033d98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:16 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:45668
I20260812 11:15:16.260586 923 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c90c5a485df4980868c9aac32033d98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:16 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:49482
I20260812 11:15:16.260867 1396 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c90c5a485df4980868c9aac32033d98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:16 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:33838
I20260812 11:15:16.263708 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 820
I20260812 11:15:16.274219 1588 tablet_replica.cc:330] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d: stopping tablet replica
I20260812 11:15:16.275794 1588 raft_consensus.cc:2229] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:15:16.277058 1591 tablet_replica.cc:330] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace: stopping tablet replica
I20260812 11:15:16.277724 1591 raft_consensus.cc:2229] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:15:16.278191 1592 tablet_replica.cc:330] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746: stopping tablet replica
I20260812 11:15:16.278368 1591 raft_consensus.cc:2258] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:15:16.278595 1592 raft_consensus.cc:2229] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:15:16.279114 1592 raft_consensus.cc:2258] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:15:16.279361 1588 raft_consensus.cc:2258] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:15:16.281213 1591 ts_tablet_manager.cc:1905] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:15:16.281739 1592 ts_tablet_manager.cc:1905] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:15:16.287245 1588 ts_tablet_manager.cc:1905] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:15:16.288535 1591 ts_tablet_manager.cc:1918] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:16.288614 1592 ts_tablet_manager.cc:1918] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:16.288733 1591 log.cc:1196] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/2c90c5a485df4980868c9aac32033d98
I20260812 11:15:16.288961 1592 log.cc:1196] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/2c90c5a485df4980868c9aac32033d98
I20260812 11:15:16.289379 1591 ts_tablet_manager.cc:1939] T 2c90c5a485df4980868c9aac32033d98 P b9e1df38932f472da02119f30790eace: Deleting consensus metadata
Aug 12 11:15:16 dist-test-slave-rmhg krb5kdc[626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:15:16.289723 1592 ts_tablet_manager.cc:1939] T 2c90c5a485df4980868c9aac32033d98 P acd68959d08f41ee9b293bc13f355746: Deleting consensus metadata
I20260812 11:15:16.291467 684 catalog_manager.cc:4841] TS b9e1df38932f472da02119f30790eace (127.4.26.65:33829): tablet 2c90c5a485df4980868c9aac32033d98 (table test-table [id=8379fd10d5d6492e9b2e61f4380d8b74]) successfully deleted
I20260812 11:15:16.292055 681 catalog_manager.cc:4841] TS acd68959d08f41ee9b293bc13f355746 (127.4.26.67:33239): tablet 2c90c5a485df4980868c9aac32033d98 (table test-table [id=8379fd10d5d6492e9b2e61f4380d8b74]) successfully deleted
I20260812 11:15:16.294672 1588 ts_tablet_manager.cc:1918] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:16.294878 1588 log.cc:1196] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/2c90c5a485df4980868c9aac32033d98
I20260812 11:15:16.295418 1588 ts_tablet_manager.cc:1939] T 2c90c5a485df4980868c9aac32033d98 P 14e09f298b4540978af95237e67add2d: Deleting consensus metadata
I20260812 11:15:16.297266 686 catalog_manager.cc:4841] TS 14e09f298b4540978af95237e67add2d (127.4.26.66:37667): tablet 2c90c5a485df4980868c9aac32033d98 (table test-table [id=8379fd10d5d6492e9b2e61f4380d8b74]) successfully deleted
I20260812 11:15:16.298454 1546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:16.265333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49484 (local address 127.4.26.65:33829)
0812 11:15:16.265541 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:16.265549 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:16.276664 (+ 11115us) server_negotiation.cc:407] Connection header received
0812 11:15:16.276919 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:16.276925 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:16.277021 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:16.277185 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:16.280910 (+ 3725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.282174 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.284279 (+ 2105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.284981 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.285100 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:16.290903 (+ 5803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:16.290922 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:16.290942 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:16.290998 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:16.294809 (+ 3811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:16.295937 (+ 1128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:16.295949 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:16.295952 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:16.296188 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:16.296698 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:16.296703 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:16.296707 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:16.297266 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:16.297668 (+ 402us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:16.297906 (+ 238us) server_negotiation.cc:299] Negotiation successful
0812 11:15:16.298167 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 11:15:16.299185 1030 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:16.397836 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 820
I20260812 11:15:16.443662 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 1048
Aug 12 11:15:16 dist-test-slave-rmhg krb5kdc[626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:15:16.466235 1541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:16.445343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45686 (local address 127.4.26.66:37667)
0812 11:15:16.445525 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:16.445531 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:16.445552 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:15:16.445619 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:16.445624 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:16.445722 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:16.445834 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:16.447588 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.448867 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.450448 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.451096 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.451227 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:16.458788 (+ 7561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:16.458814 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:16.458846 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:16.458920 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:16.462984 (+ 4064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:16.463812 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:16.463823 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:16.463827 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:16.464021 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:16.464405 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:16.464411 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:16.464415 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:16.464993 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:16.465390 (+ 397us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:16.465569 (+ 179us) server_negotiation.cc:299] Negotiation successful
0812 11:15:16.465819 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 11:15:16.467108 1274 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:16.582489 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 1048
I20260812 11:15:16.612119 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 1292
Aug 12 11:15:16 dist-test-slave-rmhg krb5kdc[626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:15:16.632004 1542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:16.613095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33850 (local address 127.4.26.67:33239)
0812 11:15:16.613334 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:16.613341 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:16.613360 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:15:16.613421 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:16.613425 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:16.613497 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:16.613594 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:16.615099 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.615882 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.617603 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:16.618093 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:16.618196 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:16.625509 (+ 7313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:16.625532 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:16.625552 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:16.625602 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:16.628846 (+ 3244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:16.629661 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:16.629670 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:16.629672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:16.629827 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:16.630273 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:16.630279 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:16.630281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:16.630785 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:16.631102 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:16.631426 (+ 324us) server_negotiation.cc:299] Negotiation successful
0812 11:15:16.631644 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 11:15:16.632750 1502 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:16.727236 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 1292
I20260812 11:15:16.756086 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 648
I20260812 11:15:16.757333 769 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:16.872368 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 648
2026-08-12T11:15:16Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4809 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-12T11:15:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:15:16Z Disabled control of system clock
I20260812 11:15:16.972880 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:44153
--webserver_interface=127.4.26.126
--webserver_port=0
--builtin_ntp_servers=127.4.26.84:37773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:44153
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:15:17.326980 1609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:17.327337 1609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:17.327482 1609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:17.335523 1609 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:15:17.335665 1609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:17.335747 1609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:17.335844 1609 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:15:17.335909 1609 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:15:17.345878 1609 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:37773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:44153
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:44153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:17.347364 1609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:17.349462 1609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:17.363902 1618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:17.364568 1616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:17.365132 1622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:17.366629 1609 server_base.cc:1034] running on GCE node
I20260812 11:15:17.367545 1609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:17.369119 1609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:17.370401 1609 hybrid_clock.cc:648] HybridClock initialized: now 1786533317370348 us; error 51 us; skew 500 ppm
I20260812 11:15:17.370784 1609 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:15:17.377892 1609 webserver.cc:460] Webserver started at http://127.4.26.126:34955/ using document root <none> and password file <none>
I20260812 11:15:17.378752 1609 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:17.378880 1609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:17.379235 1609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:17.382520 1609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "a4d3c42584e64f56ae739860889fea36"
format_stamp: "Formatted at 2026-08-12 11:15:17 on dist-test-slave-rmhg"
server_key: "4a0f71c7a87ba8dc0243fe72cadad7f4"
server_key_iv: "bfa319a84674610b12dc1dbdad3e9abc"
server_key_version: "encryptionkey@0"
I20260812 11:15:17.383571 1609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "a4d3c42584e64f56ae739860889fea36"
format_stamp: "Formatted at 2026-08-12 11:15:17 on dist-test-slave-rmhg"
server_key: "4a0f71c7a87ba8dc0243fe72cadad7f4"
server_key_iv: "bfa319a84674610b12dc1dbdad3e9abc"
server_key_version: "encryptionkey@0"
I20260812 11:15:17.389763 1609 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:15:17.394019 1635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:17.395577 1609 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:15:17.395783 1609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "a4d3c42584e64f56ae739860889fea36"
format_stamp: "Formatted at 2026-08-12 11:15:17 on dist-test-slave-rmhg"
server_key: "4a0f71c7a87ba8dc0243fe72cadad7f4"
server_key_iv: "bfa319a84674610b12dc1dbdad3e9abc"
server_key_version: "encryptionkey@0"
I20260812 11:15:17.396029 1609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:17.413218 1609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:17.414121 1609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:17.414419 1609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:17.432709 1609 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:44153
I20260812 11:15:17.432723 1726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:44153 every 8 connection(s)
I20260812 11:15:17.434156 1609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:15:17.437702 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 1609
I20260812 11:15:17.437896 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:15:17.438455 4201 external_mini_cluster.cc:1428] Setting key 60255bed825182f62869d458e0f0fdde
I20260812 11:15:17.438452 1728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:17.452690 1728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36: Bootstrap starting.
I20260812 11:15:17.452761 1732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:17.440411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40980 (local address 127.4.26.126:44153)
0812 11:15:17.441527 (+ 1116us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:17.441539 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:17.441591 (+ 52us) server_negotiation.cc:407] Connection header received
0812 11:15:17.443314 (+ 1723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:17.443339 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:17.443837 (+ 498us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:17.444215 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:17.444865 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:17.446296 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:17.448085 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:17.448808 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:17.448965 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:17.450302 (+ 1337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:17.450310 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:17.450329 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:17.450925 (+ 596us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:17.451038 (+ 113us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:17.451064 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:17.451170 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:17.451373 (+ 203us) server_negotiation.cc:299] Negotiation successful
0812 11:15:17.451707 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":364,"threads_started":1}
I20260812 11:15:17.455960 1728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:17.456987 1728 log.cc:824] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:17.459761 1728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36: No bootstrap required, opened a new log
I20260812 11:15:17.467193 1728 raft_consensus.cc:348] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4d3c42584e64f56ae739860889fea36" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44153 } }
I20260812 11:15:17.467581 1728 raft_consensus.cc:374] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:17.467693 1728 raft_consensus.cc:729] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4d3c42584e64f56ae739860889fea36, State: Initialized, Role: FOLLOWER
I20260812 11:15:17.468317 1728 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4d3c42584e64f56ae739860889fea36" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44153 } }
I20260812 11:15:17.468549 1728 raft_consensus.cc:388] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:15:17.468683 1728 raft_consensus.cc:482] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:15:17.468834 1728 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:17.471060 1728 raft_consensus.cc:504] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4d3c42584e64f56ae739860889fea36" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44153 } }
I20260812 11:15:17.471606 1728 leader_election.cc:302] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a4d3c42584e64f56ae739860889fea36; no voters:
I20260812 11:15:17.472178 1728 leader_election.cc:288] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:15:17.472352 1738 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:17.473384 1738 raft_consensus.cc:686] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [term 1 LEADER]: Becoming Leader. State: Replica: a4d3c42584e64f56ae739860889fea36, State: Running, Role: LEADER
I20260812 11:15:17.474013 1738 consensus_queue.cc:237] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4d3c42584e64f56ae739860889fea36" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44153 } }
I20260812 11:15:17.474462 1728 sys_catalog.cc:564] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:15:17.476933 1742 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4d3c42584e64f56ae739860889fea36. Latest consensus state: current_term: 1 leader_uuid: "a4d3c42584e64f56ae739860889fea36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4d3c42584e64f56ae739860889fea36" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44153 } } }
I20260812 11:15:17.477144 1740 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a4d3c42584e64f56ae739860889fea36" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4d3c42584e64f56ae739860889fea36" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44153 } } }
I20260812 11:15:17.477439 1742 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:17.477474 1740 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:17.479207 1754 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:15:17.484138 1754 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:15:17.493754 1754 catalog_manager.cc:1347] Generated new cluster ID: 26f3d692e267464e99e42a382986acdf
I20260812 11:15:17.493914 1754 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:15:17.508121 1754 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:15:17.509554 1754 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:15:17.517802 1754 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36: Generated new TSK 0
I20260812 11:15:17.518738 1754 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:15:17.527284 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:44153
--builtin_ntp_servers=127.4.26.84:37773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:15:17.882997 1771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:17.883304 1771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:17.883420 1771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:17.890961 1771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:17.891078 1771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:17.891222 1771 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:15:17.900892 1771 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:37773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:44153
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:17.902338 1771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:17.904247 1771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:17.917917 1776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:17.917886 1777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:17.917847 1780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:17.919085 1771 server_base.cc:1034] running on GCE node
I20260812 11:15:17.919778 1771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:17.920810 1771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:17.922051 1771 hybrid_clock.cc:648] HybridClock initialized: now 1786533317922000 us; error 43 us; skew 500 ppm
I20260812 11:15:17.922410 1771 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:15:17.924975 1771 webserver.cc:460] Webserver started at http://127.4.26.65:40727/ using document root <none> and password file <none>
I20260812 11:15:17.925773 1771 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:17.925891 1771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:17.926219 1771 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:17.929307 1771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "b4df5c3547944affbffbcc2f012052d8"
format_stamp: "Formatted at 2026-08-12 11:15:17 on dist-test-slave-rmhg"
server_key: "1f8d5b67be5dc66a6ec128bd629f8a5c"
server_key_iv: "6a40e0698950f2b50ffd5850668db319"
server_key_version: "encryptionkey@0"
I20260812 11:15:17.930145 1771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "b4df5c3547944affbffbcc2f012052d8"
format_stamp: "Formatted at 2026-08-12 11:15:17 on dist-test-slave-rmhg"
server_key: "1f8d5b67be5dc66a6ec128bd629f8a5c"
server_key_iv: "6a40e0698950f2b50ffd5850668db319"
server_key_version: "encryptionkey@0"
I20260812 11:15:17.935597 1771 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:15:17.939404 1792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:17.940809 1771 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:15:17.940973 1771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "b4df5c3547944affbffbcc2f012052d8"
format_stamp: "Formatted at 2026-08-12 11:15:17 on dist-test-slave-rmhg"
server_key: "1f8d5b67be5dc66a6ec128bd629f8a5c"
server_key_iv: "6a40e0698950f2b50ffd5850668db319"
server_key_version: "encryptionkey@0"
I20260812 11:15:17.941272 1771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:17.966519 1771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:17.967418 1771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:17.967702 1771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:17.968765 1771 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:17.970424 1771 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:17.970518 1771 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:17.970602 1771 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:17.970683 1771 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:18.002192 1771 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:43181
I20260812 11:15:18.002267 1976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:43181 every 8 connection(s)
I20260812 11:15:18.003525 1771 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:15:18.009421 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 1771
I20260812 11:15:18.009647 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:15:18.010211 4201 external_mini_cluster.cc:1428] Setting key 35a7714d9477ec4044eb029748b5a076
I20260812 11:15:18.013610 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:44153
--builtin_ntp_servers=127.4.26.84:37773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:15:18.018385 1979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:18.006219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:50417 (local address 127.4.26.126:44153)
0812 11:15:18.006672 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:18.006676 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:18.007879 (+ 1203us) server_negotiation.cc:407] Connection header received
0812 11:15:18.010133 (+ 2254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:18.010139 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:18.010218 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:18.010358 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:18.011730 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:18.012632 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:18.015077 (+ 2445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:18.015513 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:18.015630 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:18.017522 (+ 1892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:18.017527 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:18.017530 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:18.017552 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:18.017597 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:18.017609 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:18.017687 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:18.018007 (+ 320us) server_negotiation.cc:299] Negotiation successful
0812 11:15:18.018121 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":223,"threads_started":1}
I20260812 11:15:18.019906 1980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:18.006792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:44153 (local address 127.4.26.65:50417)
0812 11:15:18.007714 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:18.007752 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:18.009742 (+ 1990us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:18.010641 (+ 899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:18.010654 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:18.010799 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:18.011506 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:18.011534 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:18.012812 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:18.012818 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:18.014857 (+ 2039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:18.014875 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:18.015770 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:18.015778 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:18.016087 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:18.017044 (+ 957us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:15:18.017047 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:18.017107 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:15:18.017285 (+ 178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:18.017703 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:18.017714 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:18.017722 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 11:15:18.017933 (+ 211us) client_negotiation.cc:240] Negotiation successful
0812 11:15:18.018393 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":276,"threads_started":1}
I20260812 11:15:18.021705 1977 heartbeater.cc:347] Connected to a master server at 127.4.26.126:44153
I20260812 11:15:18.022037 1977 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:18.022871 1977 heartbeater.cc:511] Master 127.4.26.126:44153 requested a full tablet report, sending...
I20260812 11:15:18.025066 1665 ts_manager.cc:194] Registered new tserver with Master: b4df5c3547944affbffbcc2f012052d8 (127.4.26.65:43181)
I20260812 11:15:18.026736 1665 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.26.65:50417
W20260812 11:15:18.362594 1981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:18.362907 1981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:18.363006 1981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:18.370651 1981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:18.370790 1981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:18.370903 1981 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:15:18.382040 1981 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:37773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:44153
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:18.383435 1981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:18.385315 1981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:18.398921 1987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:18.398839 1988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:18.398887 1990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:18.399863 1981 server_base.cc:1034] running on GCE node
I20260812 11:15:18.400550 1981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:18.401602 1981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:18.402827 1981 hybrid_clock.cc:648] HybridClock initialized: now 1786533318402758 us; error 57 us; skew 500 ppm
I20260812 11:15:18.403146 1981 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:15:18.405494 1981 webserver.cc:460] Webserver started at http://127.4.26.66:33597/ using document root <none> and password file <none>
I20260812 11:15:18.406193 1981 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:18.406291 1981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:18.406601 1981 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:18.409618 1981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "fc1560e5094b4f0c8024df209dfb61d9"
format_stamp: "Formatted at 2026-08-12 11:15:18 on dist-test-slave-rmhg"
server_key: "9f96f6070ea2f642b2833193ef683db2"
server_key_iv: "1b7a72cf33b33367f5399028e92aaf50"
server_key_version: "encryptionkey@0"
I20260812 11:15:18.410404 1981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "fc1560e5094b4f0c8024df209dfb61d9"
format_stamp: "Formatted at 2026-08-12 11:15:18 on dist-test-slave-rmhg"
server_key: "9f96f6070ea2f642b2833193ef683db2"
server_key_iv: "1b7a72cf33b33367f5399028e92aaf50"
server_key_version: "encryptionkey@0"
I20260812 11:15:18.415585 1981 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:15:18.419332 1997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:18.420765 1981 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:15:18.420933 1981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "fc1560e5094b4f0c8024df209dfb61d9"
format_stamp: "Formatted at 2026-08-12 11:15:18 on dist-test-slave-rmhg"
server_key: "9f96f6070ea2f642b2833193ef683db2"
server_key_iv: "1b7a72cf33b33367f5399028e92aaf50"
server_key_version: "encryptionkey@0"
I20260812 11:15:18.421190 1981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:18.445405 1981 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:18.446349 1981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:18.446650 1981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:18.447701 1981 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:18.449360 1981 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:18.449476 1981 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:18.449580 1981 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:18.449651 1981 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:18.480980 1981 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:46407
I20260812 11:15:18.481056 2180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:46407 every 8 connection(s)
I20260812 11:15:18.482354 1981 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:15:18.488502 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 1981
I20260812 11:15:18.488695 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:15:18.489319 4201 external_mini_cluster.cc:1428] Setting key b5bcdc2d2488dc6898a91bb9c5421798
I20260812 11:15:18.492424 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:44153
--builtin_ntp_servers=127.4.26.84:37773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:15:18.496446 1979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:18.485257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:60741 (local address 127.4.26.126:44153)
0812 11:15:18.485430 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:18.485434 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:18.486852 (+ 1418us) server_negotiation.cc:407] Connection header received
0812 11:15:18.488826 (+ 1974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:18.488832 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:18.488906 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:18.488997 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:18.490345 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:18.491095 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:18.493478 (+ 2383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:18.493897 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:18.494004 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:18.495696 (+ 1692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:18.495701 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:18.495704 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:18.495727 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:18.495764 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:18.495777 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:18.495844 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:18.496109 (+ 265us) server_negotiation.cc:299] Negotiation successful
0812 11:15:18.496211 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:15:18.497980 2187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:18.485767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:44153 (local address 127.4.26.66:60741)
0812 11:15:18.486688 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:18.486725 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:18.488485 (+ 1760us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:18.489299 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:18.489312 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:18.489446 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:18.490170 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:18.490188 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:18.491262 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:18.491267 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:18.493309 (+ 2042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:18.493328 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:18.494127 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:18.494134 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:18.494465 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:18.495259 (+ 794us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:15:18.495262 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:18.495325 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:15:18.495458 (+ 133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:18.495864 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:18.495874 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:18.495884 (+ 10us) client_negotiation.cc:769] Sending connection context
0812 11:15:18.496083 (+ 199us) client_negotiation.cc:240] Negotiation successful
0812 11:15:18.496556 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":263,"threads_started":1}
I20260812 11:15:18.499723 2182 heartbeater.cc:347] Connected to a master server at 127.4.26.126:44153
I20260812 11:15:18.500065 2182 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:18.501040 2182 heartbeater.cc:511] Master 127.4.26.126:44153 requested a full tablet report, sending...
I20260812 11:15:18.502759 1665 ts_manager.cc:194] Registered new tserver with Master: fc1560e5094b4f0c8024df209dfb61d9 (127.4.26.66:46407)
I20260812 11:15:18.503595 1665 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.26.66:60741
W20260812 11:15:18.854885 2188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:18.855214 2188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:18.855346 2188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:18.862895 2188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:18.863016 2188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:18.863164 2188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:15:18.872951 2188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:37773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:44153
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:18.874424 2188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:18.876430 2188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:18.890563 2201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:18.890537 2202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:18.890822 2206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:18.891333 2188 server_base.cc:1034] running on GCE node
I20260812 11:15:18.892005 2188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:18.893051 2188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:18.894282 2188 hybrid_clock.cc:648] HybridClock initialized: now 1786533318894215 us; error 59 us; skew 500 ppm
I20260812 11:15:18.894619 2188 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:15:18.897229 2188 webserver.cc:460] Webserver started at http://127.4.26.67:39639/ using document root <none> and password file <none>
I20260812 11:15:18.898002 2188 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:18.898128 2188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:18.898458 2188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:18.901791 2188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "d665fbdbf5f742dbab43d8d618aea3ff"
format_stamp: "Formatted at 2026-08-12 11:15:18 on dist-test-slave-rmhg"
server_key: "0c22f448e2917aca72a247c8be3aa6e7"
server_key_iv: "5988a01bb520c8524c2fdf1f99815f3a"
server_key_version: "encryptionkey@0"
I20260812 11:15:18.902660 2188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "d665fbdbf5f742dbab43d8d618aea3ff"
format_stamp: "Formatted at 2026-08-12 11:15:18 on dist-test-slave-rmhg"
server_key: "0c22f448e2917aca72a247c8be3aa6e7"
server_key_iv: "5988a01bb520c8524c2fdf1f99815f3a"
server_key_version: "encryptionkey@0"
I20260812 11:15:18.908609 2188 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260812 11:15:18.912631 2216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:18.914364 2188 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260812 11:15:18.914552 2188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "d665fbdbf5f742dbab43d8d618aea3ff"
format_stamp: "Formatted at 2026-08-12 11:15:18 on dist-test-slave-rmhg"
server_key: "0c22f448e2917aca72a247c8be3aa6e7"
server_key_iv: "5988a01bb520c8524c2fdf1f99815f3a"
server_key_version: "encryptionkey@0"
I20260812 11:15:18.914768 2188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:18.928119 2188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:18.929083 2188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:18.929394 2188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:18.930409 2188 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:18.931989 2188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:18.932080 2188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:18.932168 2188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:18.932224 2188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:18.964001 2188 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:33875
I20260812 11:15:18.964061 2404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:33875 every 8 connection(s)
I20260812 11:15:18.965679 2188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:15:18.969892 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 2188
I20260812 11:15:18.970083 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:15:18.970674 4201 external_mini_cluster.cc:1428] Setting key 2608de62c8bb50e058886de294108ccd
I20260812 11:15:18.979353 1979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:18.968515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:39177 (local address 127.4.26.126:44153)
0812 11:15:18.968741 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:18.968746 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:18.970492 (+ 1746us) server_negotiation.cc:407] Connection header received
0812 11:15:18.972625 (+ 2133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:18.972631 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:18.972731 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:18.972827 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:18.974060 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:18.974830 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:18.976473 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:18.976923 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:18.977036 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:18.978470 (+ 1434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:18.978475 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:18.978478 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:18.978499 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:18.978532 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:18.978544 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:18.978619 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:18.978862 (+ 243us) server_negotiation.cc:299] Negotiation successful
0812 11:15:18.978998 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:15:18.980397 2408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:18.969063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:44153 (local address 127.4.26.67:39177)
0812 11:15:18.970297 (+ 1234us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:18.970350 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:18.972330 (+ 1980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:18.973083 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:18.973092 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:18.973235 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:18.973894 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:18.973914 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:18.975005 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:18.975011 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:18.976320 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:18.976334 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:18.977192 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:18.977202 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:18.977436 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:18.978090 (+ 654us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:15:18.978092 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:18.978164 (+ 72us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:15:18.978283 (+ 119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:18.978631 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:18.978643 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:18.978651 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 11:15:18.978826 (+ 175us) client_negotiation.cc:240] Negotiation successful
0812 11:15:18.979268 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":322,"threads_started":1}
I20260812 11:15:18.981902 2405 heartbeater.cc:347] Connected to a master server at 127.4.26.126:44153
I20260812 11:15:18.982220 2405 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:18.982988 2405 heartbeater.cc:511] Master 127.4.26.126:44153 requested a full tablet report, sending...
I20260812 11:15:18.984544 1665 ts_manager.cc:194] Registered new tserver with Master: d665fbdbf5f742dbab43d8d618aea3ff (127.4.26.67:33875)
I20260812 11:15:18.985515 1665 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.26.67:39177
I20260812 11:15:18.986152 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:15:18.996397 1979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:18.990286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40984 (local address 127.4.26.126:44153)
0812 11:15:18.990495 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:18.990499 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:18.990944 (+ 445us) server_negotiation.cc:407] Connection header received
0812 11:15:18.991110 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:18.991114 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:18.991198 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:18.991289 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:18.991755 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:18.992448 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:18.994042 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:18.994485 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:18.994608 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:18.995701 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:18.995706 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:18.995709 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:18.995731 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:18.995766 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:18.995779 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:18.995856 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:18.995991 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 11:15:18.996096 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 11:15:19.000612 1665 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40984:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:15:19.010316 1665 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:15:19.030891 1977 heartbeater.cc:503] Master 127.4.26.126:44153 was elected leader, sending a full tablet report...
I20260812 11:15:19.050175 2424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:19.023377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:33875 (local address 127.0.0.1:37198)
0812 11:15:19.038727 (+ 15350us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:19.038743 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:19.038849 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:19.039906 (+ 1057us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:19.039913 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:19.039970 (+ 57us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:19.040648 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:19.040663 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.044013 (+ 3350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.044020 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:19.046669 (+ 2649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:19.046690 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.048950 (+ 2260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.048958 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:19.049247 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:19.049315 (+ 68us) client_negotiation.cc:769] Sending connection context
0812 11:15:19.049440 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 11:15:19.049671 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15208,"mutex_wait_us":23,"spinlock_wait_cycles":4736,"thread_start_us":14407,"threads_started":1}
I20260812 11:15:19.051882 2429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:19.024124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37198 (local address 127.4.26.67:33875)
0812 11:15:19.039286 (+ 15162us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:19.039294 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:19.039332 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:15:19.039433 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:19.039440 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:19.039672 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:19.039879 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:19.040877 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.043839 (+ 2962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.046999 (+ 3160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.048692 (+ 1693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.050802 (+ 2110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:19.051173 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:19.051264 (+ 91us) server_negotiation.cc:299] Negotiation successful
0812 11:15:19.051465 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14972,"thread_start_us":15962,"threads_started":1}
I20260812 11:15:19.052991 2426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:19.023230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:46407 (local address 127.0.0.1:39996)
0812 11:15:19.038301 (+ 15071us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:19.038360 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:19.038594 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:19.039905 (+ 1311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:19.039913 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:19.039958 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:19.040570 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:19.040586 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.043115 (+ 2529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.043121 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:19.047729 (+ 4608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:19.047749 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.049915 (+ 2166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.049922 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:19.050167 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:19.050207 (+ 40us) client_negotiation.cc:769] Sending connection context
0812 11:15:19.052451 (+ 2244us) client_negotiation.cc:240] Negotiation successful
0812 11:15:19.052605 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14697,"mutex_wait_us":133,"spinlock_wait_cycles":3456,"thread_start_us":16718,"threads_started":1}
I20260812 11:15:19.053516 2428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:19.023429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39996 (local address 127.4.26.66:46407)
0812 11:15:19.039178 (+ 15749us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:19.039188 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:19.039219 (+ 31us) server_negotiation.cc:407] Connection header received
0812 11:15:19.039297 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:19.039303 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:19.039533 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:19.039744 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:19.040811 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.042925 (+ 2114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.048003 (+ 5078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.049665 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.052564 (+ 2899us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:19.052886 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:19.052962 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 11:15:19.053143 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15596,"thread_start_us":15496,"threads_started":1}
I20260812 11:15:19.056344 2303 tablet_service.cc:1467] Processing CreateTablet for tablet f25fee2bc9e840279ba6957aa4c3d6e7 (DEFAULT_TABLE table=test-table [id=0b63fe8b2503463693b33b985898c5c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:19.057360 2080 tablet_service.cc:1467] Processing CreateTablet for tablet f25fee2bc9e840279ba6957aa4c3d6e7 (DEFAULT_TABLE table=test-table [id=0b63fe8b2503463693b33b985898c5c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:19.058007 2303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f25fee2bc9e840279ba6957aa4c3d6e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:19.058669 2080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f25fee2bc9e840279ba6957aa4c3d6e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:19.058941 2424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:19.040573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:43181 (local address 127.0.0.1:59316)
0812 11:15:19.050477 (+ 9904us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:19.050499 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:19.050617 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:19.053574 (+ 2957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:19.053579 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:19.053609 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:19.053785 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:19.053797 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.055753 (+ 1956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.055757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:19.056910 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:19.056931 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.058213 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.058219 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:19.058415 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:19.058448 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 11:15:19.058533 (+ 85us) client_negotiation.cc:240] Negotiation successful
0812 11:15:19.058666 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9784,"thread_start_us":11670,"threads_started":1}
I20260812 11:15:19.059785 2433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:19.040715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59316 (local address 127.4.26.65:43181)
0812 11:15:19.052856 (+ 12141us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:19.052865 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:19.052900 (+ 35us) server_negotiation.cc:407] Connection header received
0812 11:15:19.053003 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:19.053011 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:19.053349 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:19.053573 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:19.054397 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.055608 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.057075 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.058050 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.058170 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:19.058431 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:19.059285 (+ 854us) server_negotiation.cc:299] Negotiation successful
0812 11:15:19.059444 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11938,"thread_start_us":13387,"threads_started":1}
I20260812 11:15:19.063464 1870 tablet_service.cc:1467] Processing CreateTablet for tablet f25fee2bc9e840279ba6957aa4c3d6e7 (DEFAULT_TABLE table=test-table [id=0b63fe8b2503463693b33b985898c5c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:19.064956 1870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f25fee2bc9e840279ba6957aa4c3d6e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:19.075148 2435 tablet_bootstrap.cc:492] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9: Bootstrap starting.
I20260812 11:15:19.077441 2444 tablet_bootstrap.cc:492] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff: Bootstrap starting.
I20260812 11:15:19.079250 2435 tablet_bootstrap.cc:654] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:19.080415 2447 tablet_bootstrap.cc:492] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8: Bootstrap starting.
I20260812 11:15:19.080601 2435 log.cc:824] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:19.081483 2444 tablet_bootstrap.cc:654] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:19.082906 2444 log.cc:824] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:19.083823 2447 tablet_bootstrap.cc:654] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:19.085065 2447 log.cc:824] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:19.087924 2447 tablet_bootstrap.cc:492] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8: No bootstrap required, opened a new log
I20260812 11:15:19.088240 2447 ts_tablet_manager.cc:1397] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260812 11:15:19.088330 2444 tablet_bootstrap.cc:492] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff: No bootstrap required, opened a new log
I20260812 11:15:19.088584 2444 ts_tablet_manager.cc:1397] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260812 11:15:19.089638 2435 tablet_bootstrap.cc:492] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9: No bootstrap required, opened a new log
I20260812 11:15:19.089920 2435 ts_tablet_manager.cc:1397] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.007s
I20260812 11:15:19.096040 2444 raft_consensus.cc:348] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1560e5094b4f0c8024df209dfb61d9" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46407 } } peers { permanent_uuid: "d665fbdbf5f742dbab43d8d618aea3ff" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33875 } } peers { permanent_uuid: "b4df5c3547944affbffbcc2f012052d8" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 43181 } }
I20260812 11:15:19.096469 2444 raft_consensus.cc:374] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:19.096566 2444 raft_consensus.cc:729] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d665fbdbf5f742dbab43d8d618aea3ff, State: Initialized, Role: FOLLOWER
I20260812 11:15:19.097275 2444 consensus_queue.cc:260] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1560e5094b4f0c8024df209dfb61d9" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46407 } } peers { permanent_uuid: "d665fbdbf5f742dbab43d8d618aea3ff" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33875 } } peers { permanent_uuid: "b4df5c3547944affbffbcc2f012052d8" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 43181 } }
I20260812 11:15:19.098414 2405 heartbeater.cc:503] Master 127.4.26.126:44153 was elected leader, sending a full tablet report...
I20260812 11:15:19.098763 2447 raft_consensus.cc:348] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1560e5094b4f0c8024df209dfb61d9" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46407 } } peers { permanent_uuid: "d665fbdbf5f742dbab43d8d618aea3ff" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33875 } } peers { permanent_uuid: "b4df5c3547944affbffbcc2f012052d8" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 43181 } }
I20260812 11:15:19.099193 2444 ts_tablet_manager.cc:1428] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20260812 11:15:19.099210 2447 raft_consensus.cc:374] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:19.099295 2447 raft_consensus.cc:729] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4df5c3547944affbffbcc2f012052d8, State: Initialized, Role: FOLLOWER
I20260812 11:15:19.100019 2447 consensus_queue.cc:260] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1560e5094b4f0c8024df209dfb61d9" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46407 } } peers { permanent_uuid: "d665fbdbf5f742dbab43d8d618aea3ff" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33875 } } peers { permanent_uuid: "b4df5c3547944affbffbcc2f012052d8" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 43181 } }
I20260812 11:15:19.101028 2435 raft_consensus.cc:348] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1560e5094b4f0c8024df209dfb61d9" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46407 } } peers { permanent_uuid: "d665fbdbf5f742dbab43d8d618aea3ff" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33875 } } peers { permanent_uuid: "b4df5c3547944affbffbcc2f012052d8" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 43181 } }
I20260812 11:15:19.101639 2435 raft_consensus.cc:374] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:19.101737 2435 raft_consensus.cc:729] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc1560e5094b4f0c8024df209dfb61d9, State: Initialized, Role: FOLLOWER
I20260812 11:15:19.101981 2447 ts_tablet_manager.cc:1428] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260812 11:15:19.102373 2435 consensus_queue.cc:260] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1560e5094b4f0c8024df209dfb61d9" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46407 } } peers { permanent_uuid: "d665fbdbf5f742dbab43d8d618aea3ff" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33875 } } peers { permanent_uuid: "b4df5c3547944affbffbcc2f012052d8" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 43181 } }
I20260812 11:15:19.104211 2182 heartbeater.cc:503] Master 127.4.26.126:44153 was elected leader, sending a full tablet report...
I20260812 11:15:19.104974 2435 ts_tablet_manager.cc:1428] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260812 11:15:19.106559 2454 raft_consensus.cc:482] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:15:19.106854 2454 raft_consensus.cc:504] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1560e5094b4f0c8024df209dfb61d9" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46407 } } peers { permanent_uuid: "d665fbdbf5f742dbab43d8d618aea3ff" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33875 } } peers { permanent_uuid: "b4df5c3547944affbffbcc2f012052d8" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 43181 } }
I20260812 11:15:19.108477 2454 leader_election.cc:288] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc1560e5094b4f0c8024df209dfb61d9 (127.4.26.66:46407), d665fbdbf5f742dbab43d8d618aea3ff (127.4.26.67:33875)
I20260812 11:15:19.115049 2428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:19.108731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:53263 (local address 127.4.26.66:46407)
0812 11:15:19.108906 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:19.108913 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:19.109444 (+ 531us) server_negotiation.cc:407] Connection header received
0812 11:15:19.109699 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:19.109704 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:19.109790 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:19.109853 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:19.110439 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.111284 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.113303 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.114124 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.114223 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:19.114307 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:19.114659 (+ 352us) server_negotiation.cc:299] Negotiation successful
0812 11:15:19.114796 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:15:19.115059 2460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:19.108699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:46407 (local address 127.4.26.65:53263)
0812 11:15:19.109350 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:19.109368 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:19.109503 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:19.110008 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:19.110011 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:19.110033 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:19.110315 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:19.110323 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.111413 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.111419 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:19.113094 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:19.113107 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.114319 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.114326 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:19.114493 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:19.114530 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:15:19.114616 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 11:15:19.114755 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"mutex_wait_us":1,"thread_start_us":328,"threads_started":1}
I20260812 11:15:19.115357 2429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:19.109746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:52773 (local address 127.4.26.67:33875)
0812 11:15:19.109932 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:19.109938 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:19.109957 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:15:19.110099 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:19.110104 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:19.110162 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:19.110233 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:19.110853 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.111691 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.113551 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.114458 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.114580 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:19.114688 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:19.115041 (+ 353us) server_negotiation.cc:299] Negotiation successful
0812 11:15:19.115172 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:15:19.115444 2461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:19.109179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:33875 (local address 127.4.26.65:52773)
0812 11:15:19.109858 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:19.109877 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:19.109990 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:19.110271 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:19.110275 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:19.110306 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:19.110676 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:19.110689 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.111835 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.111838 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:19.113373 (+ 1535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:19.113387 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.114699 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.114707 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:19.114867 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:19.114900 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 11:15:19.114996 (+ 96us) client_negotiation.cc:240] Negotiation successful
0812 11:15:19.115132 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"mutex_wait_us":21,"thread_start_us":361,"threads_started":1}
I20260812 11:15:19.116353 2336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f25fee2bc9e840279ba6957aa4c3d6e7" candidate_uuid: "b4df5c3547944affbffbcc2f012052d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d665fbdbf5f742dbab43d8d618aea3ff" is_pre_election: true
I20260812 11:15:19.116377 2111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f25fee2bc9e840279ba6957aa4c3d6e7" candidate_uuid: "b4df5c3547944affbffbcc2f012052d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc1560e5094b4f0c8024df209dfb61d9" is_pre_election: true
I20260812 11:15:19.116830 2111 raft_consensus.cc:2454] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4df5c3547944affbffbcc2f012052d8 in term 0.
I20260812 11:15:19.116832 2336 raft_consensus.cc:2454] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4df5c3547944affbffbcc2f012052d8 in term 0.
I20260812 11:15:19.117462 1797 leader_election.cc:302] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4df5c3547944affbffbcc2f012052d8, fc1560e5094b4f0c8024df209dfb61d9; no voters:
I20260812 11:15:19.117808 2454 raft_consensus.cc:2781] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:15:19.117960 2454 raft_consensus.cc:482] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:15:19.118074 2454 raft_consensus.cc:3037] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:19.120276 2454 raft_consensus.cc:504] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1560e5094b4f0c8024df209dfb61d9" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46407 } } peers { permanent_uuid: "d665fbdbf5f742dbab43d8d618aea3ff" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33875 } } peers { permanent_uuid: "b4df5c3547944affbffbcc2f012052d8" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 43181 } }
I20260812 11:15:19.120900 2454 leader_election.cc:288] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [CANDIDATE]: Term 1 election: Requested vote from peers fc1560e5094b4f0c8024df209dfb61d9 (127.4.26.66:46407), d665fbdbf5f742dbab43d8d618aea3ff (127.4.26.67:33875)
I20260812 11:15:19.121425 2111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f25fee2bc9e840279ba6957aa4c3d6e7" candidate_uuid: "b4df5c3547944affbffbcc2f012052d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc1560e5094b4f0c8024df209dfb61d9"
I20260812 11:15:19.121471 2336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f25fee2bc9e840279ba6957aa4c3d6e7" candidate_uuid: "b4df5c3547944affbffbcc2f012052d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d665fbdbf5f742dbab43d8d618aea3ff"
I20260812 11:15:19.121609 2111 raft_consensus.cc:3037] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:19.121680 2336 raft_consensus.cc:3037] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:19.124018 2111 raft_consensus.cc:2454] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4df5c3547944affbffbcc2f012052d8 in term 1.
I20260812 11:15:19.124228 2336 raft_consensus.cc:2454] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4df5c3547944affbffbcc2f012052d8 in term 1.
I20260812 11:15:19.124410 1797 leader_election.cc:302] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4df5c3547944affbffbcc2f012052d8, fc1560e5094b4f0c8024df209dfb61d9; no voters:
I20260812 11:15:19.124825 2454 raft_consensus.cc:2781] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:19.125293 2454 raft_consensus.cc:686] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [term 1 LEADER]: Becoming Leader. State: Replica: b4df5c3547944affbffbcc2f012052d8, State: Running, Role: LEADER
I20260812 11:15:19.125799 2454 consensus_queue.cc:237] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1560e5094b4f0c8024df209dfb61d9" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46407 } } peers { permanent_uuid: "d665fbdbf5f742dbab43d8d618aea3ff" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33875 } } peers { permanent_uuid: "b4df5c3547944affbffbcc2f012052d8" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 43181 } }
I20260812 11:15:19.130734 1665 catalog_manager.cc:5495] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4df5c3547944affbffbcc2f012052d8 (127.4.26.65). New cstate: current_term: 1 leader_uuid: "b4df5c3547944affbffbcc2f012052d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc1560e5094b4f0c8024df209dfb61d9" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d665fbdbf5f742dbab43d8d618aea3ff" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4df5c3547944affbffbcc2f012052d8" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 43181 } health_report { overall_health: HEALTHY } } }
I20260812 11:15:19.156636 2433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:19.151361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59326 (local address 127.4.26.65:43181)
0812 11:15:19.151567 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:19.151572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:19.151643 (+ 71us) server_negotiation.cc:407] Connection header received
0812 11:15:19.151823 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:19.151826 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:19.151918 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:19.152043 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:15:19.152351 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.153056 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.154534 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.154956 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.155063 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:19.155567 (+ 504us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:15:19.156089 (+ 522us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:15:19.156212 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:19.156324 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 11:15:19.156390 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260812 11:15:19.164983 2111 raft_consensus.cc:1261] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9 [term 1 FOLLOWER]: Refusing update from remote peer b4df5c3547944affbffbcc2f012052d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:15:19.164994 2336 raft_consensus.cc:1261] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff [term 1 FOLLOWER]: Refusing update from remote peer b4df5c3547944affbffbcc2f012052d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:15:19.165992 2462 consensus_queue.cc:1035] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d665fbdbf5f742dbab43d8d618aea3ff" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 33875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:15:19.166402 2454 consensus_queue.cc:1035] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc1560e5094b4f0c8024df209dfb61d9" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:15:19.193764 1665 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40984:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:15:19.194028 1665 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40984:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:15:19.197707 1665 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a4d3c42584e64f56ae739860889fea36: Sending DeleteTablet for 3 replicas of tablet f25fee2bc9e840279ba6957aa4c3d6e7
I20260812 11:15:19.198958 2080 tablet_service.cc:1514] Processing DeleteTablet for tablet f25fee2bc9e840279ba6957aa4c3d6e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:19 UTC) from {username='slave'} at 127.0.0.1:39996
I20260812 11:15:19.198979 2303 tablet_service.cc:1514] Processing DeleteTablet for tablet f25fee2bc9e840279ba6957aa4c3d6e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:19 UTC) from {username='slave'} at 127.0.0.1:37198
I20260812 11:15:19.199934 2485 tablet_replica.cc:330] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9: stopping tablet replica
I20260812 11:15:19.199918 1870 tablet_service.cc:1514] Processing DeleteTablet for tablet f25fee2bc9e840279ba6957aa4c3d6e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:19 UTC) from {username='slave'} at 127.0.0.1:59316
I20260812 11:15:19.200523 2485 raft_consensus.cc:2229] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:15:19.200838 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 1771
I20260812 11:15:19.201335 2485 raft_consensus.cc:2258] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:15:19.203879 2485 ts_tablet_manager.cc:1905] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:15:19.212127 2485 ts_tablet_manager.cc:1918] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:19.213372 2487 tablet_replica.cc:330] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8: stopping tablet replica
I20260812 11:15:19.213922 2487 raft_consensus.cc:2229] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:15:19.214689 2487 raft_consensus.cc:2258] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:15:19.212527 2485 log.cc:1196] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/f25fee2bc9e840279ba6957aa4c3d6e7
I20260812 11:15:19.217353 2487 ts_tablet_manager.cc:1905] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:15:19.219105 2486 tablet_replica.cc:330] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff: stopping tablet replica
I20260812 11:15:19.219370 2485 ts_tablet_manager.cc:1939] T f25fee2bc9e840279ba6957aa4c3d6e7 P fc1560e5094b4f0c8024df209dfb61d9: Deleting consensus metadata
I20260812 11:15:19.219580 2486 raft_consensus.cc:2229] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:15:19.220356 2486 raft_consensus.cc:2258] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:15:19.223809 1640 catalog_manager.cc:4841] TS fc1560e5094b4f0c8024df209dfb61d9 (127.4.26.66:46407): tablet f25fee2bc9e840279ba6957aa4c3d6e7 (table test-table [id=0b63fe8b2503463693b33b985898c5c9]) successfully deleted
I20260812 11:15:19.224617 2487 ts_tablet_manager.cc:1918] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:19.224825 2487 log.cc:1196] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/f25fee2bc9e840279ba6957aa4c3d6e7
I20260812 11:15:19.225438 2487 ts_tablet_manager.cc:1939] T f25fee2bc9e840279ba6957aa4c3d6e7 P b4df5c3547944affbffbcc2f012052d8: Deleting consensus metadata
I20260812 11:15:19.226372 2433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:19.202170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59338 (local address 127.4.26.65:43181)
0812 11:15:19.202346 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:19.202352 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:19.212403 (+ 10051us) server_negotiation.cc:407] Connection header received
0812 11:15:19.212650 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:19.212656 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:19.212766 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:19.212899 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:19.213757 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.214969 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.219982 (+ 5013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.220684 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.220801 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:19.224014 (+ 3213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:19.224027 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:19.224047 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:19.224967 (+ 920us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:19.225038 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:19.225067 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:19.225278 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:19.225710 (+ 432us) server_negotiation.cc:299] Negotiation successful
0812 11:15:19.225924 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:15:19.226969 2486 ts_tablet_manager.cc:1905] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:15:19.227319 1640 catalog_manager.cc:4841] TS b4df5c3547944affbffbcc2f012052d8 (127.4.26.65:43181): tablet f25fee2bc9e840279ba6957aa4c3d6e7 (table test-table [id=0b63fe8b2503463693b33b985898c5c9]) successfully deleted
I20260812 11:15:19.227844 1969 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:19.233510 2486 ts_tablet_manager.cc:1918] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:19.233707 2486 log.cc:1196] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/f25fee2bc9e840279ba6957aa4c3d6e7
I20260812 11:15:19.234159 2486 ts_tablet_manager.cc:1939] T f25fee2bc9e840279ba6957aa4c3d6e7 P d665fbdbf5f742dbab43d8d618aea3ff: Deleting consensus metadata
I20260812 11:15:19.235934 1637 catalog_manager.cc:4841] TS d665fbdbf5f742dbab43d8d618aea3ff (127.4.26.67:33875): tablet f25fee2bc9e840279ba6957aa4c3d6e7 (table test-table [id=0b63fe8b2503463693b33b985898c5c9]) successfully deleted
I20260812 11:15:19.325915 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 1771
I20260812 11:15:19.353874 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 1981
I20260812 11:15:19.360749 2428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:19.354750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40002 (local address 127.4.26.66:46407)
0812 11:15:19.354928 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:19.354933 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:19.354951 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:15:19.355053 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:19.355057 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:19.355142 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:19.355225 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:19.355614 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.356400 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.357756 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.358190 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.358294 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:19.359335 (+ 1041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:19.359345 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:19.359361 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:19.359994 (+ 633us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:19.360044 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:19.360064 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:19.360152 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:19.360272 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 11:15:19.360365 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:15:19.361537 2175 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:19.450812 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 1981
I20260812 11:15:19.476572 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 2188
I20260812 11:15:19.483547 2429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:19.477389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37212 (local address 127.4.26.67:33875)
0812 11:15:19.477553 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:19.477557 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:19.477603 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:15:19.477789 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:19.477793 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:19.477898 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:19.477999 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:19.478384 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.479131 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.480564 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:19.481108 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:19.481283 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:19.482279 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:19.482287 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:19.482304 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:19.482880 (+ 576us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:19.482928 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:19.482952 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:19.483037 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:19.483149 (+ 112us) server_negotiation.cc:299] Negotiation successful
0812 11:15:19.483248 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260812 11:15:19.484185 2398 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:19.573424 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 2188
I20260812 11:15:19.597683 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 1609
I20260812 11:15:19.598802 1721 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:19.707358 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 1609
2026-08-12T11:15:19Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2828 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:15:19 dist-test-slave-rmhg krb5kdc[2504](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:15:19 dist-test-slave-rmhg krb5kdc[2504](info): set up 2 sockets
Aug 12 11:15:19 dist-test-slave-rmhg krb5kdc[2504](info): commencing operation
krb5kdc: starting...
W20260812 11:15:20.985991 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:15:21 dist-test-slave-rmhg krb5kdc[2504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:15:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:15:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:15:21.308494 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:42703
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:36125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:42703
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:21.665781 2518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:21.666119 2518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:21.666260 2518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:21.673763 2518 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:15:21.673913 2518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:21.674041 2518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:21.674136 2518 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:15:21.674201 2518 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:15:21.684614 2518 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:36125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:42703
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:42703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:21.686373 2518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:21.687811 2518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:21.700611 2529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:21.700857 2530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:21.700647 2535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:21.701213 2518 server_base.cc:1034] running on GCE node
I20260812 11:15:21.702119 2518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:21.703732 2518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:21.704967 2518 hybrid_clock.cc:648] HybridClock initialized: now 1786533321704899 us; error 56 us; skew 500 ppm
I20260812 11:15:21.705380 2518 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:21 dist-test-slave-rmhg krb5kdc[2504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533321, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:21.708587 2518 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:15:21.710196 2518 webserver.cc:460] Webserver started at http://127.4.26.126:39265/ using document root <none> and password file <none>
I20260812 11:15:21.710871 2518 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:21.710975 2518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:21.711256 2518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:21.714443 2518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "4a923345c6e64109ac62bbcd79a05493"
format_stamp: "Formatted at 2026-08-12 11:15:21 on dist-test-slave-rmhg"
server_key: "2156dea4a5cd17082e2ee65da6e02ca7"
server_key_iv: "1b931c23d2dda4304b43853704263878"
server_key_version: "encryptionkey@0"
I20260812 11:15:21.715214 2518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "4a923345c6e64109ac62bbcd79a05493"
format_stamp: "Formatted at 2026-08-12 11:15:21 on dist-test-slave-rmhg"
server_key: "2156dea4a5cd17082e2ee65da6e02ca7"
server_key_iv: "1b931c23d2dda4304b43853704263878"
server_key_version: "encryptionkey@0"
I20260812 11:15:21.720839 2518 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:15:21.724761 2549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:21.726287 2518 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:15:21.726457 2518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "4a923345c6e64109ac62bbcd79a05493"
format_stamp: "Formatted at 2026-08-12 11:15:21 on dist-test-slave-rmhg"
server_key: "2156dea4a5cd17082e2ee65da6e02ca7"
server_key_iv: "1b931c23d2dda4304b43853704263878"
server_key_version: "encryptionkey@0"
I20260812 11:15:21.726644 2518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:21.748474 2518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:21.753238 2518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:21.753515 2518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:21.772115 2518 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:42703
I20260812 11:15:21.772189 2637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:42703 every 8 connection(s)
I20260812 11:15:21.773819 2518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:15:21.778156 2638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:21.781080 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 2518
I20260812 11:15:21.781296 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:15:21.781849 4201 external_mini_cluster.cc:1428] Setting key 0b7cf48e8fe73d220404cc778cca068d
I20260812 11:15:21.791473 2638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493: Bootstrap starting.
I20260812 11:15:21.795940 2638 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:21.797500 2638 log.cc:824] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:15:21 dist-test-slave-rmhg krb5kdc[2504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:15:21.801268 2638 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493: No bootstrap required, opened a new log
I20260812 11:15:21.808422 2643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:21.784136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60108 (local address 127.4.26.126:42703)
0812 11:15:21.784966 (+ 830us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:21.784979 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:21.785028 (+ 49us) server_negotiation.cc:407] Connection header received
0812 11:15:21.786853 (+ 1825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:21.786880 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:21.787328 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:21.787733 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:21.789672 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:21.791162 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:21.793406 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:21.794261 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:21.794427 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:21.799994 (+ 5567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:21.800004 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:21.800022 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:21.800067 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:21.803420 (+ 3353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:21.804422 (+ 1002us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:21.804430 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:21.804449 (+ 19us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:21.804671 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:21.805245 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:21.805249 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:21.805251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:21.805920 (+ 669us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:21.806213 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:21.806738 (+ 525us) server_negotiation.cc:299] Negotiation successful
0812 11:15:21.807188 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":366,"threads_started":1}
I20260812 11:15:21.810881 2638 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a923345c6e64109ac62bbcd79a05493" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42703 } }
I20260812 11:15:21.811290 2638 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:21.811388 2638 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a923345c6e64109ac62bbcd79a05493, State: Initialized, Role: FOLLOWER
I20260812 11:15:21.812018 2638 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a923345c6e64109ac62bbcd79a05493" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42703 } }
I20260812 11:15:21.812250 2638 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:15:21.812352 2638 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:15:21.812477 2638 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:21.814751 2638 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a923345c6e64109ac62bbcd79a05493" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42703 } }
I20260812 11:15:21.815274 2638 leader_election.cc:302] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a923345c6e64109ac62bbcd79a05493; no voters:
I20260812 11:15:21.815845 2638 leader_election.cc:288] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:15:21.815984 2648 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:21.817098 2648 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [term 1 LEADER]: Becoming Leader. State: Replica: 4a923345c6e64109ac62bbcd79a05493, State: Running, Role: LEADER
I20260812 11:15:21.817763 2648 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a923345c6e64109ac62bbcd79a05493" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42703 } }
I20260812 11:15:21.818254 2638 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:15:21.820551 2650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a923345c6e64109ac62bbcd79a05493" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a923345c6e64109ac62bbcd79a05493" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42703 } } }
I20260812 11:15:21.820960 2650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:21.820781 2651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a923345c6e64109ac62bbcd79a05493. Latest consensus state: current_term: 1 leader_uuid: "4a923345c6e64109ac62bbcd79a05493" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a923345c6e64109ac62bbcd79a05493" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42703 } } }
I20260812 11:15:21.821146 2651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:21.823482 2662 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:15:21.828754 2662 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:15:21.839279 2662 catalog_manager.cc:1347] Generated new cluster ID: b8860cfede774fcfac32391d8b2033af
I20260812 11:15:21.839426 2662 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:15:21.881783 2662 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:15:21.883297 2662 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:15:21.891031 2662 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493: Generated new TSK 0
I20260812 11:15:21.891964 2662 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:15:21.966322 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:42703
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:36125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:22.322639 2681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:22.323009 2681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:22.323168 2681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:22.331169 2681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:22.331305 2681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:22.331456 2681 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:15:22.341729 2681 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:36125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:42703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:22.343060 2681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:22.344358 2681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:22.358248 2695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:22.358108 2698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:22.358345 2696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:22.359470 2681 server_base.cc:1034] running on GCE node
I20260812 11:15:22.360195 2681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:22.361299 2681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:22.362527 2681 hybrid_clock.cc:648] HybridClock initialized: now 1786533322362469 us; error 56 us; skew 500 ppm
I20260812 11:15:22.362869 2681 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:22 dist-test-slave-rmhg krb5kdc[2504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533322, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:22.366144 2681 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:15:22.367607 2681 webserver.cc:460] Webserver started at http://127.4.26.65:39623/ using document root <none> and password file <none>
I20260812 11:15:22.368299 2681 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:22.368402 2681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:22.368680 2681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:22.371729 2681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "5968517ee404411bbcd0b06686e06c97"
format_stamp: "Formatted at 2026-08-12 11:15:22 on dist-test-slave-rmhg"
server_key: "87496853f140689666d244ab93d4a772"
server_key_iv: "29716e2754e0f6f4dbb27a011f25b518"
server_key_version: "encryptionkey@0"
I20260812 11:15:22.372784 2681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "5968517ee404411bbcd0b06686e06c97"
format_stamp: "Formatted at 2026-08-12 11:15:22 on dist-test-slave-rmhg"
server_key: "87496853f140689666d244ab93d4a772"
server_key_iv: "29716e2754e0f6f4dbb27a011f25b518"
server_key_version: "encryptionkey@0"
I20260812 11:15:22.380455 2681 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.004s
I20260812 11:15:22.385659 2713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:22.387764 2681 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:15:22.387991 2681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "5968517ee404411bbcd0b06686e06c97"
format_stamp: "Formatted at 2026-08-12 11:15:22 on dist-test-slave-rmhg"
server_key: "87496853f140689666d244ab93d4a772"
server_key_iv: "29716e2754e0f6f4dbb27a011f25b518"
server_key_version: "encryptionkey@0"
I20260812 11:15:22.388273 2681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:22.422953 2681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:22.427268 2681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:22.427564 2681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:22.428635 2681 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:22.430078 2681 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:22.430153 2681 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:22.430267 2681 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:22.430326 2681 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:22.461401 2681 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:35409
I20260812 11:15:22.461437 2911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:35409 every 8 connection(s)
I20260812 11:15:22.462785 2681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:15:22.469501 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 2681
I20260812 11:15:22.469708 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:15:22.470151 4201 external_mini_cluster.cc:1428] Setting key ad634279db6a42bc4cf86e81b9fe8d58
Aug 12 11:15:22 dist-test-slave-rmhg krb5kdc[2504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533322, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:15:22.483662 2918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:22.465332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:51061 (local address 127.4.26.126:42703)
0812 11:15:22.465843 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:22.465849 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:22.466856 (+ 1007us) server_negotiation.cc:407] Connection header received
0812 11:15:22.468702 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:22.468707 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:22.468779 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:22.468876 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:22.470571 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:22.471429 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:22.473329 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:22.473830 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:22.473949 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:22.477807 (+ 3858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:22.477813 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:22.477817 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:22.477854 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:22.480426 (+ 2572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:22.481278 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:22.481283 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:22.481285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:22.481416 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:22.481859 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:22.481863 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:22.481865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:22.482149 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:22.482289 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:22.483033 (+ 744us) server_negotiation.cc:299] Negotiation successful
0812 11:15:22.483288 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":208,"threads_started":1}
I20260812 11:15:22.484935 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:22.465929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:42703 (local address 127.4.26.65:51061)
0812 11:15:22.466679 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:22.466720 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:22.468405 (+ 1685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:22.469097 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:22.469105 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:22.469693 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:22.470373 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:22.470394 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:22.471676 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:22.471680 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:22.473147 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:22.473197 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:22.474080 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:22.474088 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:22.474334 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:22.475013 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:15:22.475037 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:22.477542 (+ 2505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:22.480630 (+ 3088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:22.480640 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:22.480661 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:22.481129 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:22.481534 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:22.481539 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:22.481543 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:22.481737 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:22.482280 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:22.482288 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:22.482646 (+ 358us) client_negotiation.cc:769] Sending connection context
0812 11:15:22.482889 (+ 243us) client_negotiation.cc:240] Negotiation successful
0812 11:15:22.483478 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":303,"threads_started":1}
I20260812 11:15:22.486668 2916 heartbeater.cc:347] Connected to a master server at 127.4.26.126:42703
I20260812 11:15:22.487016 2916 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:22.487764 2916 heartbeater.cc:511] Master 127.4.26.126:42703 requested a full tablet report, sending...
I20260812 11:15:22.490293 2578 ts_manager.cc:194] Registered new tserver with Master: 5968517ee404411bbcd0b06686e06c97 (127.4.26.65:35409)
I20260812 11:15:22.492286 2578 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:51061
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:15:22.539959 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:42703
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:36125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:22.893672 2922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:22.893996 2922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:22.894109 2922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:22.901510 2922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:22.901640 2922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:22.901764 2922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:15:22.911800 2922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:36125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:42703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:22.913110 2922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:22.914440 2922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:22.927788 2930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:22.927819 2935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:22.927757 2932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:22.928524 2922 server_base.cc:1034] running on GCE node
I20260812 11:15:22.929193 2922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:22.930306 2922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:22.931581 2922 hybrid_clock.cc:648] HybridClock initialized: now 1786533322931521 us; error 53 us; skew 500 ppm
I20260812 11:15:22.931926 2922 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:22 dist-test-slave-rmhg krb5kdc[2504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533322, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:22.935134 2922 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:15:22.936666 2922 webserver.cc:460] Webserver started at http://127.4.26.66:46635/ using document root <none> and password file <none>
I20260812 11:15:22.937445 2922 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:22.937577 2922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:22.937883 2922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:22.940884 2922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "919487a60c8d48f9a94954434860facb"
format_stamp: "Formatted at 2026-08-12 11:15:22 on dist-test-slave-rmhg"
server_key: "64594b5643b696019d47bdeb60b5c615"
server_key_iv: "1ff9d974d4b796ae0f914da55c35fe78"
server_key_version: "encryptionkey@0"
I20260812 11:15:22.941805 2922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "919487a60c8d48f9a94954434860facb"
format_stamp: "Formatted at 2026-08-12 11:15:22 on dist-test-slave-rmhg"
server_key: "64594b5643b696019d47bdeb60b5c615"
server_key_iv: "1ff9d974d4b796ae0f914da55c35fe78"
server_key_version: "encryptionkey@0"
I20260812 11:15:22.947409 2922 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:15:22.951402 2947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:22.952872 2922 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:15:22.953074 2922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "919487a60c8d48f9a94954434860facb"
format_stamp: "Formatted at 2026-08-12 11:15:22 on dist-test-slave-rmhg"
server_key: "64594b5643b696019d47bdeb60b5c615"
server_key_iv: "1ff9d974d4b796ae0f914da55c35fe78"
server_key_version: "encryptionkey@0"
I20260812 11:15:22.953322 2922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:22.977360 2922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:22.982427 2922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:22.982746 2922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:22.983847 2922 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:22.985473 2922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:22.985566 2922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:22.985688 2922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:22.985750 2922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:23.017603 2922 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:45409
I20260812 11:15:23.017647 3136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:45409 every 8 connection(s)
I20260812 11:15:23.019101 2922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:15:23.023075 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 2922
I20260812 11:15:23.023293 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:15:23.023882 4201 external_mini_cluster.cc:1428] Setting key 4e73617c699cbc2bb76d97c14a9fec3f
Aug 12 11:15:23 dist-test-slave-rmhg krb5kdc[2504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533322, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:15:23.042534 3140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.021894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:43293 (local address 127.4.26.126:42703)
0812 11:15:23.022372 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:23.022378 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:23.025530 (+ 3152us) server_negotiation.cc:407] Connection header received
0812 11:15:23.025587 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:23.025591 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:23.025671 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:23.025782 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:23.027526 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.028568 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.030391 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.031023 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.031160 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.035556 (+ 4396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:23.035563 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:23.035567 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:23.035612 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:23.038972 (+ 3360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:23.039910 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:23.039916 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:23.039918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:23.040083 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:23.040565 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:23.040571 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:23.040574 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:23.040884 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:23.041065 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:23.042026 (+ 961us) server_negotiation.cc:299] Negotiation successful
0812 11:15:23.042244 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":258,"threads_started":1}
I20260812 11:15:23.043947 3141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.022368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:42703 (local address 127.4.26.66:43293)
0812 11:15:23.023197 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:23.023248 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:23.025218 (+ 1970us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:23.026124 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:23.026137 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:23.026718 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:23.027324 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.027343 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.028755 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.028759 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.030212 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.030227 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.031293 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.031299 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.031595 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.032397 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:15:23.032424 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:23.035239 (+ 2815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:23.039168 (+ 3929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:23.039178 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:23.039195 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:23.039735 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:23.040208 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:23.040211 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:23.040214 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:23.040426 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:23.041032 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:23.041041 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:23.041561 (+ 520us) client_negotiation.cc:769] Sending connection context
0812 11:15:23.041891 (+ 330us) client_negotiation.cc:240] Negotiation successful
0812 11:15:23.042476 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":338,"threads_started":1}
I20260812 11:15:23.045655 3137 heartbeater.cc:347] Connected to a master server at 127.4.26.126:42703
I20260812 11:15:23.045991 3137 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:23.046747 3137 heartbeater.cc:511] Master 127.4.26.126:42703 requested a full tablet report, sending...
I20260812 11:15:23.048290 2578 ts_manager.cc:194] Registered new tserver with Master: 919487a60c8d48f9a94954434860facb (127.4.26.66:45409)
I20260812 11:15:23.049185 2578 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:43293
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:15:23.093961 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:42703
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:36125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:23.447058 3145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:23.447345 3145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:23.447482 3145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:23.455062 3145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:23.455197 3145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:23.455355 3145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:15:23.466032 3145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:36125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:42703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:23.467332 3145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:23.468732 3145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:23.482290 3153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:23.482327 3155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:23.482352 3151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:23.483139 3145 server_base.cc:1034] running on GCE node
I20260812 11:15:23.483800 3145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:23.484797 3145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:23.486011 3145 hybrid_clock.cc:648] HybridClock initialized: now 1786533323485954 us; error 42 us; skew 500 ppm
I20260812 11:15:23.486363 3145 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:23 dist-test-slave-rmhg krb5kdc[2504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533323, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:23.489614 3145 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:15:23.491271 3145 webserver.cc:460] Webserver started at http://127.4.26.67:41499/ using document root <none> and password file <none>
I20260812 11:15:23.492005 3145 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:23.492141 3145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:23.492442 3145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:23.495896 2916 heartbeater.cc:503] Master 127.4.26.126:42703 was elected leader, sending a full tablet report...
I20260812 11:15:23.495676 3145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "eb113b3d942b4323851bb6d544416494"
format_stamp: "Formatted at 2026-08-12 11:15:23 on dist-test-slave-rmhg"
server_key: "9f8c9f4beabb999658acf6bc1c1e5325"
server_key_iv: "624727352b3bf5ac2070efb801fbb9ca"
server_key_version: "encryptionkey@0"
I20260812 11:15:23.496641 3145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "eb113b3d942b4323851bb6d544416494"
format_stamp: "Formatted at 2026-08-12 11:15:23 on dist-test-slave-rmhg"
server_key: "9f8c9f4beabb999658acf6bc1c1e5325"
server_key_iv: "624727352b3bf5ac2070efb801fbb9ca"
server_key_version: "encryptionkey@0"
I20260812 11:15:23.502604 3145 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 11:15:23.506677 3167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:23.508242 3145 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:15:23.508432 3145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "eb113b3d942b4323851bb6d544416494"
format_stamp: "Formatted at 2026-08-12 11:15:23 on dist-test-slave-rmhg"
server_key: "9f8c9f4beabb999658acf6bc1c1e5325"
server_key_iv: "624727352b3bf5ac2070efb801fbb9ca"
server_key_version: "encryptionkey@0"
I20260812 11:15:23.508647 3145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:23.538496 3145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:23.546553 3145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:23.546900 3145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:23.548143 3145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:23.549819 3145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:23.549911 3145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:23.550045 3145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:23.550100 3145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:23.582383 3145 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:37537
I20260812 11:15:23.582434 3355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:37537 every 8 connection(s)
I20260812 11:15:23.583765 3145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:15:23.586120 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 3145
I20260812 11:15:23.586293 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:15:23.586838 4201 external_mini_cluster.cc:1428] Setting key b5a6b561c091b3bc7286dc963634790f
Aug 12 11:15:23 dist-test-slave-rmhg krb5kdc[2504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533323, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:15:23.606144 3361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.586732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:60227 (local address 127.4.26.126:42703)
0812 11:15:23.587391 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:23.587398 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:23.588484 (+ 1086us) server_negotiation.cc:407] Connection header received
0812 11:15:23.590787 (+ 2303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:23.590791 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:23.590864 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:23.590961 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:23.592669 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.593703 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.595573 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.596004 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.596118 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.599930 (+ 3812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:23.599936 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:23.599939 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:23.599980 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:23.602837 (+ 2857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:23.603704 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:23.603709 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:23.603711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:23.603862 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:23.604363 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:23.604366 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:23.604369 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:23.604707 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:23.604833 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:23.605664 (+ 831us) server_negotiation.cc:299] Negotiation successful
0812 11:15:23.605856 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":362,"threads_started":1}
I20260812 11:15:23.607190 3363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.587368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:42703 (local address 127.4.26.67:60227)
0812 11:15:23.588307 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:23.588369 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:23.590509 (+ 2140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:23.591216 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:23.591225 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:23.591789 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:23.592455 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.592475 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.593866 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.593870 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.595364 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.595380 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.596252 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.596258 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.596485 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.597253 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:15:23.597279 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:23.599645 (+ 2366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:23.602991 (+ 3346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:23.603000 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:23.603018 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:23.603531 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:23.604006 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:23.604010 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:23.604012 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:23.604270 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:23.604811 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:23.604817 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:23.605263 (+ 446us) client_negotiation.cc:769] Sending connection context
0812 11:15:23.605528 (+ 265us) client_negotiation.cc:240] Negotiation successful
0812 11:15:23.606003 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":348,"threads_started":1}
I20260812 11:15:23.608855 3358 heartbeater.cc:347] Connected to a master server at 127.4.26.126:42703
I20260812 11:15:23.609194 3358 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:23.609961 3358 heartbeater.cc:511] Master 127.4.26.126:42703 requested a full tablet report, sending...
I20260812 11:15:23.611599 2578 ts_manager.cc:194] Registered new tserver with Master: eb113b3d942b4323851bb6d544416494 (127.4.26.67:37537)
I20260812 11:15:23.612461 2578 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:60227
I20260812 11:15:23.615494 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:15:23.635191 3361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.620275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60116 (local address 127.4.26.126:42703)
0812 11:15:23.620570 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:23.620577 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:23.620951 (+ 374us) server_negotiation.cc:407] Connection header received
0812 11:15:23.621226 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:23.621230 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:23.621305 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:23.621396 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:23.623129 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.623935 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.625466 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.625924 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.626064 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.629065 (+ 3001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:23.629071 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:23.629075 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:23.629116 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:23.632025 (+ 2909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:23.632956 (+ 931us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:23.632960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:23.632963 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:23.633111 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:23.633631 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:23.633635 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:23.633638 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:23.633981 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:23.634243 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:23.634715 (+ 472us) server_negotiation.cc:299] Negotiation successful
0812 11:15:23.634922 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 11:15:23.639649 2578 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:15:23.646833 2578 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:15:23.669806 3379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.659780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52666 (local address 127.4.26.65:35409)
0812 11:15:23.660576 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:23.660586 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:23.661193 (+ 607us) server_negotiation.cc:407] Connection header received
0812 11:15:23.661562 (+ 369us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:23.661570 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:23.661863 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:23.662041 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:23.663047 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.664674 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.667042 (+ 2368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.668278 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.668397 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.668660 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:23.669257 (+ 597us) server_negotiation.cc:299] Negotiation successful
0812 11:15:23.669449 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":410,"threads_started":1}
I20260812 11:15:23.669878 3375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.659436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:35409 (local address 127.0.0.1:52666)
0812 11:15:23.661003 (+ 1567us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:23.661045 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:23.661306 (+ 261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:23.662396 (+ 1090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:23.662404 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:23.662454 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:23.662858 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.662870 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.664839 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.664844 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.666881 (+ 2037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.666893 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.668741 (+ 1848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.668749 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.668975 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.669037 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 11:15:23.669217 (+ 180us) client_negotiation.cc:240] Negotiation successful
0812 11:15:23.669455 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1274,"mutex_wait_us":4,"spinlock_wait_cycles":4864,"thread_start_us":1247,"threads_started":1}
I20260812 11:15:23.671420 3384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.661821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55910 (local address 127.4.26.67:37537)
0812 11:15:23.662816 (+ 995us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:23.662822 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:23.662849 (+ 27us) server_negotiation.cc:407] Connection header received
0812 11:15:23.662923 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:23.662928 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:23.663157 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:23.663964 (+ 807us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:23.664253 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.666105 (+ 1852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.668949 (+ 2844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.670383 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.670505 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.670753 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:23.670947 (+ 194us) server_negotiation.cc:299] Negotiation successful
0812 11:15:23.671130 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":843,"thread_start_us":694,"threads_started":1}
I20260812 11:15:23.671433 3382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.661528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:37537 (local address 127.0.0.1:55910)
0812 11:15:23.662144 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:23.662170 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:23.662284 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:23.663375 (+ 1091us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:23.663380 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:23.663405 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:23.663774 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.663787 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.666257 (+ 2470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.666263 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.668748 (+ 2485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.668762 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.670589 (+ 1827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.670595 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.670771 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.670803 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 11:15:23.670887 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 11:15:23.671023 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"mutex_wait_us":82,"thread_start_us":296,"threads_started":1}
I20260812 11:15:23.673409 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.659981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:45409 (local address 127.0.0.1:56844)
0812 11:15:23.661002 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:23.661046 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:23.661250 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:23.664159 (+ 2909us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:23.664165 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:23.664190 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:23.664655 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.664668 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.666236 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.666241 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.668995 (+ 2754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.669007 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.671492 (+ 2485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.671500 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.672726 (+ 1226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.672760 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:15:23.672852 (+ 92us) client_negotiation.cc:240] Negotiation successful
0812 11:15:23.672997 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":894,"mutex_wait_us":98,"thread_start_us":763,"threads_started":1}
I20260812 11:15:23.674310 3381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.660495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56844 (local address 127.4.26.66:45409)
0812 11:15:23.663427 (+ 2932us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:23.663442 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:23.663463 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:15:23.663537 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:23.663542 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:23.663692 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:23.663873 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:23.664877 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.666089 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.669219 (+ 3130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.671001 (+ 1782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.671129 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.671317 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:23.673785 (+ 2468us) server_negotiation.cc:299] Negotiation successful
0812 11:15:23.673988 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2795,"thread_start_us":2658,"threads_started":1}
I20260812 11:15:23.674723 2793 tablet_service.cc:1467] Processing CreateTablet for tablet d9573d24993045dfab6338ebfdc32085 (DEFAULT_TABLE table=test-table [id=ad5f844b5759439b87a584422c8f079e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:23.675091 3235 tablet_service.cc:1467] Processing CreateTablet for tablet d9573d24993045dfab6338ebfdc32085 (DEFAULT_TABLE table=test-table [id=ad5f844b5759439b87a584422c8f079e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:23.676397 3235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9573d24993045dfab6338ebfdc32085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:23.676425 2793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9573d24993045dfab6338ebfdc32085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:23.678128 3018 tablet_service.cc:1467] Processing CreateTablet for tablet d9573d24993045dfab6338ebfdc32085 (DEFAULT_TABLE table=test-table [id=ad5f844b5759439b87a584422c8f079e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:23.680163 3018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9573d24993045dfab6338ebfdc32085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:23.688444 3385 tablet_bootstrap.cc:492] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494: Bootstrap starting.
I20260812 11:15:23.691241 3386 tablet_bootstrap.cc:492] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97: Bootstrap starting.
I20260812 11:15:23.692842 3385 tablet_bootstrap.cc:654] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:23.694485 3385 log.cc:824] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:23.695099 3386 tablet_bootstrap.cc:654] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:23.696413 3386 log.cc:824] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:23.699739 3387 tablet_bootstrap.cc:492] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb: Bootstrap starting.
I20260812 11:15:23.700115 3386 tablet_bootstrap.cc:492] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97: No bootstrap required, opened a new log
I20260812 11:15:23.700417 3386 ts_tablet_manager.cc:1397] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 11:15:23.701279 3385 tablet_bootstrap.cc:492] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494: No bootstrap required, opened a new log
I20260812 11:15:23.701704 3385 ts_tablet_manager.cc:1397] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.003s
I20260812 11:15:23.703660 3387 tablet_bootstrap.cc:654] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:23.704990 3387 log.cc:824] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:23.709313 3385 raft_consensus.cc:348] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5968517ee404411bbcd0b06686e06c97" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 35409 } } peers { permanent_uuid: "eb113b3d942b4323851bb6d544416494" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 37537 } } peers { permanent_uuid: "919487a60c8d48f9a94954434860facb" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 45409 } }
I20260812 11:15:23.709843 3385 raft_consensus.cc:374] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:23.709964 3385 raft_consensus.cc:729] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb113b3d942b4323851bb6d544416494, State: Initialized, Role: FOLLOWER
I20260812 11:15:23.710703 3385 consensus_queue.cc:260] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5968517ee404411bbcd0b06686e06c97" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 35409 } } peers { permanent_uuid: "eb113b3d942b4323851bb6d544416494" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 37537 } } peers { permanent_uuid: "919487a60c8d48f9a94954434860facb" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 45409 } }
I20260812 11:15:23.711040 3386 raft_consensus.cc:348] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5968517ee404411bbcd0b06686e06c97" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 35409 } } peers { permanent_uuid: "eb113b3d942b4323851bb6d544416494" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 37537 } } peers { permanent_uuid: "919487a60c8d48f9a94954434860facb" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 45409 } }
I20260812 11:15:23.711504 3386 raft_consensus.cc:374] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:23.711627 3386 raft_consensus.cc:729] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5968517ee404411bbcd0b06686e06c97, State: Initialized, Role: FOLLOWER
I20260812 11:15:23.712044 3358 heartbeater.cc:503] Master 127.4.26.126:42703 was elected leader, sending a full tablet report...
I20260812 11:15:23.712350 3387 tablet_bootstrap.cc:492] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb: No bootstrap required, opened a new log
I20260812 11:15:23.712556 3385 ts_tablet_manager.cc:1428] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494: Time spent starting tablet: real 0.011s user 0.010s sys 0.001s
I20260812 11:15:23.712731 3387 ts_tablet_manager.cc:1397] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.004s
I20260812 11:15:23.713927 3386 consensus_queue.cc:260] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5968517ee404411bbcd0b06686e06c97" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 35409 } } peers { permanent_uuid: "eb113b3d942b4323851bb6d544416494" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 37537 } } peers { permanent_uuid: "919487a60c8d48f9a94954434860facb" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 45409 } }
I20260812 11:15:23.715806 3386 ts_tablet_manager.cc:1428] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260812 11:15:23.722796 3387 raft_consensus.cc:348] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5968517ee404411bbcd0b06686e06c97" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 35409 } } peers { permanent_uuid: "eb113b3d942b4323851bb6d544416494" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 37537 } } peers { permanent_uuid: "919487a60c8d48f9a94954434860facb" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 45409 } }
I20260812 11:15:23.723258 3387 raft_consensus.cc:374] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:23.723361 3387 raft_consensus.cc:729] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 919487a60c8d48f9a94954434860facb, State: Initialized, Role: FOLLOWER
I20260812 11:15:23.723966 3387 consensus_queue.cc:260] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5968517ee404411bbcd0b06686e06c97" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 35409 } } peers { permanent_uuid: "eb113b3d942b4323851bb6d544416494" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 37537 } } peers { permanent_uuid: "919487a60c8d48f9a94954434860facb" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 45409 } }
I20260812 11:15:23.725096 3137 heartbeater.cc:503] Master 127.4.26.126:42703 was elected leader, sending a full tablet report...
I20260812 11:15:23.725600 3387 ts_tablet_manager.cc:1428] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
W20260812 11:15:23.771224 3138 tablet.cc:2369] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:15:23.835558 3359 tablet.cc:2369] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:15:23.855641 3398 raft_consensus.cc:482] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:15:23.856041 3398 raft_consensus.cc:504] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5968517ee404411bbcd0b06686e06c97" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 35409 } } peers { permanent_uuid: "eb113b3d942b4323851bb6d544416494" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 37537 } } peers { permanent_uuid: "919487a60c8d48f9a94954434860facb" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 45409 } }
I20260812 11:15:23.857580 3396 raft_consensus.cc:482] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:15:23.857857 3396 raft_consensus.cc:504] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5968517ee404411bbcd0b06686e06c97" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 35409 } } peers { permanent_uuid: "eb113b3d942b4323851bb6d544416494" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 37537 } } peers { permanent_uuid: "919487a60c8d48f9a94954434860facb" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 45409 } }
I20260812 11:15:23.858323 3398 leader_election.cc:288] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5968517ee404411bbcd0b06686e06c97 (127.4.26.65:35409), eb113b3d942b4323851bb6d544416494 (127.4.26.67:37537)
I20260812 11:15:23.859895 3396 leader_election.cc:288] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5968517ee404411bbcd0b06686e06c97 (127.4.26.65:35409), 919487a60c8d48f9a94954434860facb (127.4.26.66:45409)
I20260812 11:15:23.867249 3379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.858813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:50735 (local address 127.4.26.65:35409)
0812 11:15:23.859027 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:23.859034 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:23.859348 (+ 314us) server_negotiation.cc:407] Connection header received
0812 11:15:23.859697 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:23.859702 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:23.859790 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:23.859857 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:23.860799 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.861974 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.864699 (+ 2725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.866087 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.866197 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.866344 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:23.866801 (+ 457us) server_negotiation.cc:299] Negotiation successful
0812 11:15:23.866952 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":76}
I20260812 11:15:23.868096 3399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.858594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:35409 (local address 127.4.26.66:50735)
0812 11:15:23.859228 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:23.859245 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:23.859493 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:23.860077 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:23.860081 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:23.860113 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:23.860605 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.860624 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.862274 (+ 1650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.862279 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.864493 (+ 2214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.864509 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.866397 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.866403 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.866590 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.866626 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:15:23.867541 (+ 915us) client_negotiation.cc:240] Negotiation successful
0812 11:15:23.867709 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":312,"threads_started":1}
I20260812 11:15:23.868441 3363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.860179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:35409 (local address 127.4.26.67:57249)
0812 11:15:23.860540 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:23.860559 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:23.860666 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:23.861618 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:23.861623 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:23.861659 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:23.861825 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.861835 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.863729 (+ 1894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.863734 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.865703 (+ 1969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.865721 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.867705 (+ 1984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.867712 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.867904 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.867941 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:15:23.868010 (+ 69us) client_negotiation.cc:240] Negotiation successful
0812 11:15:23.868166 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239}
I20260812 11:15:23.868762 3384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.859675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:56827 (local address 127.4.26.67:37537)
0812 11:15:23.859884 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:23.859890 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:23.860737 (+ 847us) server_negotiation.cc:407] Connection header received
0812 11:15:23.861003 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:23.861008 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:23.861090 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:23.861175 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:23.862051 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.863291 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.865999 (+ 2708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.867385 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.867505 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.867620 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:23.868307 (+ 687us) server_negotiation.cc:299] Negotiation successful
0812 11:15:23.868488 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 11:15:23.869477 3402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.859396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:37537 (local address 127.4.26.66:56827)
0812 11:15:23.860633 (+ 1237us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:23.860652 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:23.860843 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:23.861370 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:23.861375 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:23.861401 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:23.861837 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.861852 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.863498 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.863504 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.865789 (+ 2285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.865807 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.867855 (+ 2048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.867862 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.868093 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.868130 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:15:23.868940 (+ 810us) client_negotiation.cc:240] Negotiation successful
0812 11:15:23.869088 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1100,"thread_start_us":857,"threads_started":1}
I20260812 11:15:23.869298 2827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9573d24993045dfab6338ebfdc32085" candidate_uuid: "919487a60c8d48f9a94954434860facb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5968517ee404411bbcd0b06686e06c97" is_pre_election: true
I20260812 11:15:23.869998 2827 raft_consensus.cc:2454] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 919487a60c8d48f9a94954434860facb in term 0.
I20260812 11:15:23.870548 3405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.860572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:57249 (local address 127.4.26.65:35409)
0812 11:15:23.861328 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:23.861334 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:23.861360 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:15:23.861412 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:23.861416 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:23.861474 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:23.862024 (+ 550us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:23.862301 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.863550 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.865932 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.867536 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.869604 (+ 2068us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.869898 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:23.869955 (+ 57us) server_negotiation.cc:299] Negotiation successful
0812 11:15:23.870102 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":605,"thread_start_us":1095,"threads_started":1}
I20260812 11:15:23.871176 2827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9573d24993045dfab6338ebfdc32085" candidate_uuid: "eb113b3d942b4323851bb6d544416494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5968517ee404411bbcd0b06686e06c97" is_pre_election: true
I20260812 11:15:23.871376 2827 raft_consensus.cc:2454] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb113b3d942b4323851bb6d544416494 in term 0.
I20260812 11:15:23.871717 2948 leader_election.cc:302] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5968517ee404411bbcd0b06686e06c97, 919487a60c8d48f9a94954434860facb; no voters:
I20260812 11:15:23.871903 3168 leader_election.cc:302] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5968517ee404411bbcd0b06686e06c97, eb113b3d942b4323851bb6d544416494; no voters:
I20260812 11:15:23.872197 3398 raft_consensus.cc:2781] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:15:23.872370 3398 raft_consensus.cc:482] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:15:23.872336 3396 raft_consensus.cc:2781] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:15:23.872479 3398 raft_consensus.cc:3037] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:23.872498 3396 raft_consensus.cc:482] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:15:23.872599 3396 raft_consensus.cc:3037] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:23.873008 3271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9573d24993045dfab6338ebfdc32085" candidate_uuid: "919487a60c8d48f9a94954434860facb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb113b3d942b4323851bb6d544416494" is_pre_election: true
I20260812 11:15:23.875977 3381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.861634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:59213 (local address 127.4.26.66:45409)
0812 11:15:23.862195 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:23.862201 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:23.869022 (+ 6821us) server_negotiation.cc:407] Connection header received
0812 11:15:23.869084 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:23.869087 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:23.869173 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:23.869266 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:23.869808 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.870810 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.874048 (+ 3238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.875042 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.875174 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.875270 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:23.875588 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 11:15:23.875714 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432}
I20260812 11:15:23.875921 3398 raft_consensus.cc:504] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5968517ee404411bbcd0b06686e06c97" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 35409 } } peers { permanent_uuid: "eb113b3d942b4323851bb6d544416494" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 37537 } } peers { permanent_uuid: "919487a60c8d48f9a94954434860facb" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 45409 } }
I20260812 11:15:23.875918 3396 raft_consensus.cc:504] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5968517ee404411bbcd0b06686e06c97" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 35409 } } peers { permanent_uuid: "eb113b3d942b4323851bb6d544416494" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 37537 } } peers { permanent_uuid: "919487a60c8d48f9a94954434860facb" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 45409 } }
I20260812 11:15:23.876055 3363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.861194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:45409 (local address 127.4.26.67:59213)
0812 11:15:23.868689 (+ 7495us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:23.868709 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:23.868837 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:23.869423 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:23.869427 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:23.869455 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:23.869636 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.869659 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.870978 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.870983 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.873868 (+ 2885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:23.873886 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.875225 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.875231 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:23.875433 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.875461 (+ 28us) client_negotiation.cc:769] Sending connection context
0812 11:15:23.875545 (+ 84us) client_negotiation.cc:240] Negotiation successful
0812 11:15:23.875695 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7393,"thread_start_us":9576,"threads_started":1}
I20260812 11:15:23.876705 3271 raft_consensus.cc:2379] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 919487a60c8d48f9a94954434860facb in current term 1: Already voted for candidate eb113b3d942b4323851bb6d544416494 in this term.
I20260812 11:15:23.877184 2827 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9573d24993045dfab6338ebfdc32085" candidate_uuid: "919487a60c8d48f9a94954434860facb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5968517ee404411bbcd0b06686e06c97"
I20260812 11:15:23.877204 3049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9573d24993045dfab6338ebfdc32085" candidate_uuid: "eb113b3d942b4323851bb6d544416494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "919487a60c8d48f9a94954434860facb" is_pre_election: true
I20260812 11:15:23.877436 2827 raft_consensus.cc:3037] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:23.877727 3049 raft_consensus.cc:2379] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb113b3d942b4323851bb6d544416494 in current term 1: Already voted for candidate 919487a60c8d48f9a94954434860facb in this term.
I20260812 11:15:23.878325 3398 leader_election.cc:288] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [CANDIDATE]: Term 1 election: Requested vote from peers 5968517ee404411bbcd0b06686e06c97 (127.4.26.65:35409), eb113b3d942b4323851bb6d544416494 (127.4.26.67:37537)
I20260812 11:15:23.878420 3270 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9573d24993045dfab6338ebfdc32085" candidate_uuid: "919487a60c8d48f9a94954434860facb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb113b3d942b4323851bb6d544416494"
I20260812 11:15:23.878767 3270 raft_consensus.cc:2379] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 919487a60c8d48f9a94954434860facb in current term 1: Already voted for candidate eb113b3d942b4323851bb6d544416494 in this term.
I20260812 11:15:23.879278 3396 leader_election.cc:288] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [CANDIDATE]: Term 1 election: Requested vote from peers 5968517ee404411bbcd0b06686e06c97 (127.4.26.65:35409), 919487a60c8d48f9a94954434860facb (127.4.26.66:45409)
I20260812 11:15:23.879779 3049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9573d24993045dfab6338ebfdc32085" candidate_uuid: "eb113b3d942b4323851bb6d544416494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "919487a60c8d48f9a94954434860facb"
I20260812 11:15:23.880020 3049 raft_consensus.cc:2379] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eb113b3d942b4323851bb6d544416494 in current term 1: Already voted for candidate 919487a60c8d48f9a94954434860facb in this term.
I20260812 11:15:23.880095 2826 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9573d24993045dfab6338ebfdc32085" candidate_uuid: "eb113b3d942b4323851bb6d544416494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5968517ee404411bbcd0b06686e06c97"
I20260812 11:15:23.880499 2827 raft_consensus.cc:2454] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 919487a60c8d48f9a94954434860facb in term 1.
I20260812 11:15:23.880870 2948 leader_election.cc:302] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5968517ee404411bbcd0b06686e06c97, 919487a60c8d48f9a94954434860facb; no voters: eb113b3d942b4323851bb6d544416494
I20260812 11:15:23.880975 3168 leader_election.cc:302] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb113b3d942b4323851bb6d544416494; no voters: 5968517ee404411bbcd0b06686e06c97, 919487a60c8d48f9a94954434860facb
I20260812 11:15:23.881214 3398 raft_consensus.cc:2781] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:23.881327 3396 raft_consensus.cc:2726] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 11:15:23.881721 3398 raft_consensus.cc:686] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [term 1 LEADER]: Becoming Leader. State: Replica: 919487a60c8d48f9a94954434860facb, State: Running, Role: LEADER
I20260812 11:15:23.882205 3398 consensus_queue.cc:237] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5968517ee404411bbcd0b06686e06c97" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 35409 } } peers { permanent_uuid: "eb113b3d942b4323851bb6d544416494" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 37537 } } peers { permanent_uuid: "919487a60c8d48f9a94954434860facb" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 45409 } }
I20260812 11:15:23.886826 2577 catalog_manager.cc:5495] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb reported cstate change: term changed from 0 to 1, leader changed from <none> to 919487a60c8d48f9a94954434860facb (127.4.26.66). New cstate: current_term: 1 leader_uuid: "919487a60c8d48f9a94954434860facb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5968517ee404411bbcd0b06686e06c97" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb113b3d942b4323851bb6d544416494" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 37537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "919487a60c8d48f9a94954434860facb" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 45409 } health_report { overall_health: HEALTHY } } }
I20260812 11:15:23.917284 3381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.911335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56850 (local address 127.4.26.66:45409)
0812 11:15:23.911547 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:23.911553 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:23.911575 (+ 22us) server_negotiation.cc:407] Connection header received
0812 11:15:23.911776 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:23.911780 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:23.911862 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:23.912013 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:15:23.912426 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.913295 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.914772 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.915211 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.915325 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.916037 (+ 712us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:15:23.916581 (+ 544us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:15:23.916757 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:23.916927 (+ 170us) server_negotiation.cc:299] Negotiation successful
0812 11:15:23.916987 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260812 11:15:23.926674 2826 raft_consensus.cc:1261] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97 [term 1 FOLLOWER]: Refusing update from remote peer 919487a60c8d48f9a94954434860facb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:15:23.926695 3270 raft_consensus.cc:1261] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [term 1 FOLLOWER]: Refusing update from remote peer 919487a60c8d48f9a94954434860facb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:15:23.927659 3407 consensus_queue.cc:1035] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5968517ee404411bbcd0b06686e06c97" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:15:23.928052 3398 consensus_queue.cc:1035] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb113b3d942b4323851bb6d544416494" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 37537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:15:23.939934 3412 mvcc.cc:205] Tried to move back new op lower bound from 7317640494791962624 to 7317640494625304576. Current Snapshot: MvccSnapshot[applied={T|T < 7317640494791962624}]
I20260812 11:15:23.945464 3415 mvcc.cc:205] Tried to move back new op lower bound from 7317640494791962624 to 7317640494625304576. Current Snapshot: MvccSnapshot[applied={T|T < 7317640494791962624}]
I20260812 11:15:23.946734 3414 mvcc.cc:205] Tried to move back new op lower bound from 7317640494791962624 to 7317640494625304576. Current Snapshot: MvccSnapshot[applied={T|T < 7317640494791962624}]
I20260812 11:15:23.956687 2577 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:15:23.957049 2577 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:15:23.961686 2577 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4a923345c6e64109ac62bbcd79a05493: Sending DeleteTablet for 3 replicas of tablet d9573d24993045dfab6338ebfdc32085
I20260812 11:15:23.962947 3018 tablet_service.cc:1514] Processing DeleteTablet for tablet d9573d24993045dfab6338ebfdc32085 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:23 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:56844
I20260812 11:15:23.962947 2793 tablet_service.cc:1514] Processing DeleteTablet for tablet d9573d24993045dfab6338ebfdc32085 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:23 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:52666
I20260812 11:15:23.963676 3017 tablet_service.cc:1514] Processing DeleteTablet for tablet d9573d24993045dfab6338ebfdc32085 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:23 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:56844
I20260812 11:15:23.964377 3235 tablet_service.cc:1514] Processing DeleteTablet for tablet d9573d24993045dfab6338ebfdc32085 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:23 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:55910
I20260812 11:15:23.967391 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 2681
I20260812 11:15:23.988099 3433 tablet_replica.cc:330] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494: stopping tablet replica
I20260812 11:15:23.988894 3433 raft_consensus.cc:2229] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:15:23.989080 3430 tablet_replica.cc:330] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb: stopping tablet replica
I20260812 11:15:23.989576 3430 raft_consensus.cc:2229] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:15:23.989810 3433 raft_consensus.cc:2258] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:15:23.990314 3430 raft_consensus.cc:2258] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 12 11:15:23 dist-test-slave-rmhg krb5kdc[2504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:15:23.994851 3433 ts_tablet_manager.cc:1905] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:15:23.995030 3430 ts_tablet_manager.cc:1905] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:15:24.002976 3430 ts_tablet_manager.cc:1918] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:24.003362 3430 log.cc:1196] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/d9573d24993045dfab6338ebfdc32085
I20260812 11:15:24.003611 3405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:23.970419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52672 (local address 127.4.26.65:35409)
0812 11:15:23.970647 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:23.970653 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:23.980693 (+ 10040us) server_negotiation.cc:407] Connection header received
0812 11:15:23.981268 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:23.981275 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:23.981373 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:23.981446 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:23.983490 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.984743 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.986861 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:23.987535 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:23.987652 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:23.995480 (+ 7828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:23.995501 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:23.995519 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:23.995590 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:23.999576 (+ 3986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:24.000685 (+ 1109us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:24.000696 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:24.000700 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:24.000886 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:24.001427 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:24.001432 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:24.001436 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:24.001945 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:24.002242 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:24.002964 (+ 722us) server_negotiation.cc:299] Negotiation successful
0812 11:15:24.003246 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:15:24.004050 3433 ts_tablet_manager.cc:1918] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:24.004256 3433 log.cc:1196] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/d9573d24993045dfab6338ebfdc32085
I20260812 11:15:24.004822 3430 ts_tablet_manager.cc:1939] T d9573d24993045dfab6338ebfdc32085 P 919487a60c8d48f9a94954434860facb: Deleting consensus metadata
I20260812 11:15:24.004845 3433 ts_tablet_manager.cc:1939] T d9573d24993045dfab6338ebfdc32085 P eb113b3d942b4323851bb6d544416494: Deleting consensus metadata
I20260812 11:15:24.005218 2907 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:24.007290 2555 catalog_manager.cc:4841] TS 919487a60c8d48f9a94954434860facb (127.4.26.66:45409): tablet d9573d24993045dfab6338ebfdc32085 (table test-table [id=ad5f844b5759439b87a584422c8f079e]) successfully deleted
I20260812 11:15:24.007619 2551 catalog_manager.cc:4841] TS eb113b3d942b4323851bb6d544416494 (127.4.26.67:37537): tablet d9573d24993045dfab6338ebfdc32085 (table test-table [id=ad5f844b5759439b87a584422c8f079e]) successfully deleted
W20260812 11:15:24.008719 2555 catalog_manager.cc:4808] TS 919487a60c8d48f9a94954434860facb (127.4.26.66:45409): delete failed for tablet d9573d24993045dfab6338ebfdc32085 because the tablet was not found. No further retry: Not found: Tablet not found: d9573d24993045dfab6338ebfdc32085
I20260812 11:15:24.128515 3427 tablet_replica.cc:330] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97: stopping tablet replica
I20260812 11:15:24.128994 3427 raft_consensus.cc:2229] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:15:24.129427 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 2681
I20260812 11:15:24.129562 3427 raft_consensus.cc:2258] T d9573d24993045dfab6338ebfdc32085 P 5968517ee404411bbcd0b06686e06c97 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 11:15:24.162043 2551 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.26.65:35409 (error 108)
I20260812 11:15:24.162715 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 2922
I20260812 11:15:24.164211 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:24.163647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:35409 (local address 127.0.0.1:52676)
0812 11:15:24.163907 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:24.164040 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:35409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150}
W20260812 11:15:24.164515 2551 catalog_manager.cc:4584] TS 5968517ee404411bbcd0b06686e06c97 (127.4.26.65:35409): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d9573d24993045dfab6338ebfdc32085: Network error: Client connection negotiation failed: client connection to 127.4.26.65:35409: connect: Connection refused (error 111)
Aug 12 11:15:24 dist-test-slave-rmhg krb5kdc[2504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:15:24.182498 3381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:24.163572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56854 (local address 127.4.26.66:45409)
0812 11:15:24.163757 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:24.163763 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:24.163865 (+ 102us) server_negotiation.cc:407] Connection header received
0812 11:15:24.164060 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:24.164066 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:24.164191 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:24.164306 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:24.166154 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:24.167043 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:24.168995 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:24.169582 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:24.169689 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:24.175342 (+ 5653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:24.175361 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:24.175383 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:24.175437 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:24.179175 (+ 3738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:24.180279 (+ 1104us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:24.180289 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:24.180292 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:24.180476 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:24.180886 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:24.180888 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:24.180890 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:24.181395 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:24.181663 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:24.182015 (+ 352us) server_negotiation.cc:299] Negotiation successful
0812 11:15:24.182230 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 11:15:24.183377 3126 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:24.218394 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:24.217781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:35409 (local address 127.0.0.1:52680)
0812 11:15:24.218038 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:24.218172 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:35409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260812 11:15:24.219657 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:24.219230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:35409 (local address 127.0.0.1:52686)
0812 11:15:24.219404 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:24.219489 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:35409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 11:15:24.280331 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:24.279833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:35409 (local address 127.0.0.1:52692)
0812 11:15:24.280050 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:24.280150 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:35409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260812 11:15:24.281468 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:24.281081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:35409 (local address 127.0.0.1:52702)
0812 11:15:24.281263 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:24.281341 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:35409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260812 11:15:24.302217 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 2922
I20260812 11:15:24.330003 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 3145
Aug 12 11:15:24 dist-test-slave-rmhg krb5kdc[2504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533321, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:15:24.345363 3384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:24.330776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55916 (local address 127.4.26.67:37537)
0812 11:15:24.330965 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:24.330969 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:24.330989 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:15:24.331184 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:24.331188 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:24.331266 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:24.331351 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:24.332706 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:24.333493 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:24.334732 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:24.335125 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:24.335219 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:24.339823 (+ 4604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:24.339841 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:24.339860 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:24.339898 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:24.342729 (+ 2831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:24.343464 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:24.343473 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:24.343475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:24.343623 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:24.343943 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:24.343946 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:24.343948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:24.344331 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:24.344580 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:24.344851 (+ 271us) server_negotiation.cc:299] Negotiation successful
0812 11:15:24.345031 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 11:15:24.346019 3350 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:24.362301 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:24.361761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:35409 (local address 127.0.0.1:52716)
0812 11:15:24.362015 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:24.362113 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:35409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260812 11:15:24.363372 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:24.362961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:35409 (local address 127.0.0.1:52718)
0812 11:15:24.363167 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:24.363254 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:35409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260812 11:15:24.439553 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 3145
I20260812 11:15:24.462148 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 2518
I20260812 11:15:24.463224 2629 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:24.573441 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 2518
I20260812 11:15:24.573540 3380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:24.572951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:35409 (local address 127.0.0.1:52728)
0812 11:15:24.573193 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:24.573296 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:35409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
2026-08-12T11:15:24Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4869 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-12T11:15:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:15:24Z Disabled control of system clock
I20260812 11:15:24.672392 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:46077
--webserver_interface=127.4.26.126
--webserver_port=0
--builtin_ntp_servers=127.4.26.84:40417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:46077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:15:25.029702 3458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:25.030079 3458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:25.030221 3458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:25.038087 3458 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:15:25.038220 3458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:25.038290 3458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:25.038367 3458 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:15:25.038425 3458 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:15:25.048022 3458 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:46077
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:46077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:25.049490 3458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:25.051383 3458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:25.068218 3464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:25.070422 3466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:25.071288 3469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:25.072306 3458 server_base.cc:1034] running on GCE node
I20260812 11:15:25.073503 3458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:25.075603 3458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:25.076880 3458 hybrid_clock.cc:648] HybridClock initialized: now 1786533325076793 us; error 84 us; skew 500 ppm
I20260812 11:15:25.077373 3458 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:15:25.080426 3458 webserver.cc:460] Webserver started at http://127.4.26.126:45495/ using document root <none> and password file <none>
I20260812 11:15:25.081383 3458 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:25.081511 3458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:25.081871 3458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:25.086169 3458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "84cd77edf20246e8a7bad4b0489fb813"
format_stamp: "Formatted at 2026-08-12 11:15:25 on dist-test-slave-rmhg"
server_key: "d3b60257e9d3783475e56a964a7a3f96"
server_key_iv: "3772d8e1c7e55afefd23a92a36f5a784"
server_key_version: "encryptionkey@0"
I20260812 11:15:25.087276 3458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "84cd77edf20246e8a7bad4b0489fb813"
format_stamp: "Formatted at 2026-08-12 11:15:25 on dist-test-slave-rmhg"
server_key: "d3b60257e9d3783475e56a964a7a3f96"
server_key_iv: "3772d8e1c7e55afefd23a92a36f5a784"
server_key_version: "encryptionkey@0"
I20260812 11:15:25.094807 3458 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260812 11:15:25.099969 3480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:25.101886 3458 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260812 11:15:25.102104 3458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "84cd77edf20246e8a7bad4b0489fb813"
format_stamp: "Formatted at 2026-08-12 11:15:25 on dist-test-slave-rmhg"
server_key: "d3b60257e9d3783475e56a964a7a3f96"
server_key_iv: "3772d8e1c7e55afefd23a92a36f5a784"
server_key_version: "encryptionkey@0"
I20260812 11:15:25.102375 3458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:25.127559 3458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:25.128525 3458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:25.128840 3458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:25.147828 3458 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:46077
I20260812 11:15:25.147853 3577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:46077 every 8 connection(s)
I20260812 11:15:25.149367 3458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:15:25.153471 3580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:25.154557 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 3458
I20260812 11:15:25.154752 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:15:25.155202 4201 external_mini_cluster.cc:1428] Setting key f99c287dc3f9521e5fcf40bc605015bc
I20260812 11:15:25.168334 3580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813: Bootstrap starting.
I20260812 11:15:25.170563 3586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:25.157414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41846 (local address 127.4.26.126:46077)
0812 11:15:25.158626 (+ 1212us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:25.158642 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:25.158695 (+ 53us) server_negotiation.cc:407] Connection header received
0812 11:15:25.160411 (+ 1716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:25.160445 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:25.161020 (+ 575us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:25.161463 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:25.162123 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:25.163479 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:25.165585 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:25.166408 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:25.166574 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:25.167898 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:25.167907 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:25.167929 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:25.168558 (+ 629us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:25.168676 (+ 118us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:25.168708 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:25.168803 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:25.169085 (+ 282us) server_negotiation.cc:299] Negotiation successful
0812 11:15:25.169525 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":713,"thread_start_us":429,"threads_started":1}
I20260812 11:15:25.172384 3580 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:25.173573 3580 log.cc:824] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:25.176502 3580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813: No bootstrap required, opened a new log
I20260812 11:15:25.184183 3580 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84cd77edf20246e8a7bad4b0489fb813" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 46077 } }
I20260812 11:15:25.184609 3580 raft_consensus.cc:374] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:25.184712 3580 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84cd77edf20246e8a7bad4b0489fb813, State: Initialized, Role: FOLLOWER
I20260812 11:15:25.185437 3580 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84cd77edf20246e8a7bad4b0489fb813" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 46077 } }
I20260812 11:15:25.185679 3580 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:15:25.185808 3580 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:15:25.185951 3580 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:25.188090 3580 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84cd77edf20246e8a7bad4b0489fb813" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 46077 } }
I20260812 11:15:25.188619 3580 leader_election.cc:302] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84cd77edf20246e8a7bad4b0489fb813; no voters:
I20260812 11:15:25.189204 3580 leader_election.cc:288] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:15:25.189366 3589 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:25.190070 3589 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [term 1 LEADER]: Becoming Leader. State: Replica: 84cd77edf20246e8a7bad4b0489fb813, State: Running, Role: LEADER
I20260812 11:15:25.190600 3589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84cd77edf20246e8a7bad4b0489fb813" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 46077 } }
I20260812 11:15:25.191298 3580 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:15:25.193432 3596 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84cd77edf20246e8a7bad4b0489fb813" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84cd77edf20246e8a7bad4b0489fb813" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 46077 } } }
I20260812 11:15:25.193506 3598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84cd77edf20246e8a7bad4b0489fb813. Latest consensus state: current_term: 1 leader_uuid: "84cd77edf20246e8a7bad4b0489fb813" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84cd77edf20246e8a7bad4b0489fb813" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 46077 } } }
I20260812 11:15:25.193950 3596 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:25.193959 3598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:25.202626 3607 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:15:25.207705 3607 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:15:25.216394 3607 catalog_manager.cc:1347] Generated new cluster ID: f7d45ab342da409ebc86fc8b65d7e396
I20260812 11:15:25.216526 3607 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:15:25.236276 3607 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:15:25.237716 3607 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:15:25.246743 3607 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813: Generated new TSK 0
I20260812 11:15:25.247648 3607 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:15:25.258857 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:46077
--builtin_ntp_servers=127.4.26.84:40417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:15:25.606871 3619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:25.607203 3619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:25.607334 3619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:25.614886 3619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:25.615001 3619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:25.615159 3619 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:15:25.624547 3619 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:46077
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:25.625939 3619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:25.627712 3619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:25.641223 3633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:25.641218 3632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:25.641886 3636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:25.641964 3619 server_base.cc:1034] running on GCE node
I20260812 11:15:25.642666 3619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:25.643762 3619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:25.644992 3619 hybrid_clock.cc:648] HybridClock initialized: now 1786533325644939 us; error 55 us; skew 500 ppm
I20260812 11:15:25.645386 3619 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:15:25.647956 3619 webserver.cc:460] Webserver started at http://127.4.26.65:42979/ using document root <none> and password file <none>
I20260812 11:15:25.648732 3619 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:25.648855 3619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:25.649217 3619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:25.652403 3619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "5d8c770f02a0440db3651e231ccfbcff"
format_stamp: "Formatted at 2026-08-12 11:15:25 on dist-test-slave-rmhg"
server_key: "19e2b3839e06e17823064b00a9853940"
server_key_iv: "ea7fdb105123a47860d6cea4352654d3"
server_key_version: "encryptionkey@0"
I20260812 11:15:25.653329 3619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "5d8c770f02a0440db3651e231ccfbcff"
format_stamp: "Formatted at 2026-08-12 11:15:25 on dist-test-slave-rmhg"
server_key: "19e2b3839e06e17823064b00a9853940"
server_key_iv: "ea7fdb105123a47860d6cea4352654d3"
server_key_version: "encryptionkey@0"
I20260812 11:15:25.658960 3619 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 11:15:25.662763 3650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:25.664235 3619 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:15:25.664424 3619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "5d8c770f02a0440db3651e231ccfbcff"
format_stamp: "Formatted at 2026-08-12 11:15:25 on dist-test-slave-rmhg"
server_key: "19e2b3839e06e17823064b00a9853940"
server_key_iv: "ea7fdb105123a47860d6cea4352654d3"
server_key_version: "encryptionkey@0"
I20260812 11:15:25.664667 3619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:25.680224 3619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:25.681296 3619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:25.681600 3619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:25.682772 3619 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:25.684374 3619 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:25.684484 3619 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:25.684572 3619 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:25.684628 3619 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:25.715593 3619 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:45311
I20260812 11:15:25.715641 3838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:45311 every 8 connection(s)
I20260812 11:15:25.716917 3619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:15:25.722888 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 3619
I20260812 11:15:25.723091 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:15:25.723562 4201 external_mini_cluster.cc:1428] Setting key 33c899a9b42ccb52092c612a83af136a
I20260812 11:15:25.726670 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:46077
--builtin_ntp_servers=127.4.26.84:40417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:15:25.730562 3845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:25.719684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:41553 (local address 127.4.26.126:46077)
0812 11:15:25.720108 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:25.720112 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:25.721390 (+ 1278us) server_negotiation.cc:407] Connection header received
0812 11:15:25.723343 (+ 1953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:25.723349 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:25.723440 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:25.723541 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:25.724930 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:25.725927 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:25.727669 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:25.728284 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:25.728416 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:25.729750 (+ 1334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:25.729756 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:25.729760 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:25.729784 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:25.729831 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:25.729846 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:25.729931 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:25.730128 (+ 197us) server_negotiation.cc:299] Negotiation successful
0812 11:15:25.730229 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":210,"threads_started":1}
I20260812 11:15:25.731546 3846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:25.720207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:46077 (local address 127.4.26.65:41553)
0812 11:15:25.721220 (+ 1013us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:25.721262 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:25.723014 (+ 1752us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:25.723823 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:25.723833 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:25.723933 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:25.724715 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:25.724745 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:25.726094 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:25.726098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:25.727509 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:25.727523 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:25.728483 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:25.728487 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:25.728702 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:25.729412 (+ 710us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:15:25.729415 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:25.729459 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:15:25.729549 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:25.729943 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:25.729950 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:25.729956 (+ 6us) client_negotiation.cc:769] Sending connection context
0812 11:15:25.730101 (+ 145us) client_negotiation.cc:240] Negotiation successful
0812 11:15:25.730444 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":294,"threads_started":1}
I20260812 11:15:25.733193 3839 heartbeater.cc:347] Connected to a master server at 127.4.26.126:46077
I20260812 11:15:25.733515 3839 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:25.734308 3839 heartbeater.cc:511] Master 127.4.26.126:46077 requested a full tablet report, sending...
I20260812 11:15:25.736544 3520 ts_manager.cc:194] Registered new tserver with Master: 5d8c770f02a0440db3651e231ccfbcff (127.4.26.65:45311)
I20260812 11:15:25.738155 3520 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.26.65:41553
W20260812 11:15:26.077539 3847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:26.077885 3847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:26.078016 3847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:26.085865 3847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:26.086020 3847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:26.086179 3847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:15:26.095692 3847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:46077
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:26.097064 3847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:26.098896 3847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:26.112052 3854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:26.111989 3857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:26.112010 3855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:26.112823 3847 server_base.cc:1034] running on GCE node
I20260812 11:15:26.113539 3847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:26.114581 3847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:26.115793 3847 hybrid_clock.cc:648] HybridClock initialized: now 1786533326115747 us; error 42 us; skew 500 ppm
I20260812 11:15:26.116151 3847 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:15:26.118642 3847 webserver.cc:460] Webserver started at http://127.4.26.66:43551/ using document root <none> and password file <none>
I20260812 11:15:26.119380 3847 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:26.119481 3847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:26.119810 3847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:26.122915 3847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "bbe45dfb6e0a4e8c9031af6b80380394"
format_stamp: "Formatted at 2026-08-12 11:15:26 on dist-test-slave-rmhg"
server_key: "8dd754bc4550b41e48de67a1eac5f22c"
server_key_iv: "2740a7096c7390a04ecc2890931d67a0"
server_key_version: "encryptionkey@0"
I20260812 11:15:26.123754 3847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "bbe45dfb6e0a4e8c9031af6b80380394"
format_stamp: "Formatted at 2026-08-12 11:15:26 on dist-test-slave-rmhg"
server_key: "8dd754bc4550b41e48de67a1eac5f22c"
server_key_iv: "2740a7096c7390a04ecc2890931d67a0"
server_key_version: "encryptionkey@0"
I20260812 11:15:26.129544 3847 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260812 11:15:26.133495 3866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:26.134984 3847 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:15:26.135201 3847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "bbe45dfb6e0a4e8c9031af6b80380394"
format_stamp: "Formatted at 2026-08-12 11:15:26 on dist-test-slave-rmhg"
server_key: "8dd754bc4550b41e48de67a1eac5f22c"
server_key_iv: "2740a7096c7390a04ecc2890931d67a0"
server_key_version: "encryptionkey@0"
I20260812 11:15:26.135438 3847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:26.162468 3847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:26.163345 3847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:26.163619 3847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:26.164690 3847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:26.166330 3847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:26.166433 3847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:26.166541 3847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:26.166613 3847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:26.197005 3847 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:46673
I20260812 11:15:26.197064 4047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:46673 every 8 connection(s)
I20260812 11:15:26.198447 3847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:15:26.199581 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 3847
I20260812 11:15:26.199776 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:15:26.200347 4201 external_mini_cluster.cc:1428] Setting key a7fd7e966f7a9e3462f44d8bc0efd806
I20260812 11:15:26.203555 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:46077
--builtin_ntp_servers=127.4.26.84:40417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:15:26.211879 3845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:26.201335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:37183 (local address 127.4.26.126:46077)
0812 11:15:26.201511 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:26.201517 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:26.203128 (+ 1611us) server_negotiation.cc:407] Connection header received
0812 11:15:26.205004 (+ 1876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:26.205009 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:26.205095 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:26.205219 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:26.206363 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.207099 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.208932 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.209400 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.209517 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:26.210995 (+ 1478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:26.211000 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:26.211004 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:26.211025 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:26.211084 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:26.211098 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:26.211181 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:26.211420 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 11:15:26.211535 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:15:26.213011 4051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:26.201904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:46077 (local address 127.4.26.66:37183)
0812 11:15:26.202972 (+ 1068us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:26.203010 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:26.204719 (+ 1709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:26.205460 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:26.205469 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:26.205573 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:26.206188 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:26.206206 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.207275 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.207279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:26.208767 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:26.208785 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.209642 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.209660 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:26.209891 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:26.210594 (+ 703us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:15:26.210597 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:26.210644 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:15:26.210752 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:26.211207 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:26.211218 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:26.211225 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 11:15:26.211395 (+ 170us) client_negotiation.cc:240] Negotiation successful
0812 11:15:26.211875 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":384,"threads_started":1}
I20260812 11:15:26.214725 4048 heartbeater.cc:347] Connected to a master server at 127.4.26.126:46077
I20260812 11:15:26.215039 4048 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:26.215960 4048 heartbeater.cc:511] Master 127.4.26.126:46077 requested a full tablet report, sending...
I20260812 11:15:26.217674 3520 ts_manager.cc:194] Registered new tserver with Master: bbe45dfb6e0a4e8c9031af6b80380394 (127.4.26.66:46673)
I20260812 11:15:26.218533 3520 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.26.66:37183
W20260812 11:15:26.556929 4052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:26.557304 4052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:26.557443 4052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:26.564898 4052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:26.565032 4052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:26.565220 4052 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:15:26.574904 4052 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:46077
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:26.576296 4052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:26.578193 4052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:26.592260 4061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:26.592165 4066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:26.592232 4063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:26.593082 4052 server_base.cc:1034] running on GCE node
I20260812 11:15:26.593727 4052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:26.594779 4052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:26.596020 4052 hybrid_clock.cc:648] HybridClock initialized: now 1786533326595949 us; error 51 us; skew 500 ppm
I20260812 11:15:26.596349 4052 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:15:26.598881 4052 webserver.cc:460] Webserver started at http://127.4.26.67:35745/ using document root <none> and password file <none>
I20260812 11:15:26.599656 4052 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:26.599773 4052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:26.600111 4052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:26.603272 4052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "c728e52f2f314fa09672c6331d40cb84"
format_stamp: "Formatted at 2026-08-12 11:15:26 on dist-test-slave-rmhg"
server_key: "1085ff5f74d0ec61f2845c4b4df81b0e"
server_key_iv: "53cc02f0f0912c4ff8f800fcec7e6869"
server_key_version: "encryptionkey@0"
I20260812 11:15:26.604159 4052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "c728e52f2f314fa09672c6331d40cb84"
format_stamp: "Formatted at 2026-08-12 11:15:26 on dist-test-slave-rmhg"
server_key: "1085ff5f74d0ec61f2845c4b4df81b0e"
server_key_iv: "53cc02f0f0912c4ff8f800fcec7e6869"
server_key_version: "encryptionkey@0"
I20260812 11:15:26.610069 4052 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260812 11:15:26.614065 4079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:26.615464 4052 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:15:26.615635 4052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "c728e52f2f314fa09672c6331d40cb84"
format_stamp: "Formatted at 2026-08-12 11:15:26 on dist-test-slave-rmhg"
server_key: "1085ff5f74d0ec61f2845c4b4df81b0e"
server_key_iv: "53cc02f0f0912c4ff8f800fcec7e6869"
server_key_version: "encryptionkey@0"
I20260812 11:15:26.615849 4052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:26.660488 4052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:26.661592 4052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:26.661875 4052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:26.662935 4052 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:26.664548 4052 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:26.664652 4052 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:26.664767 4052 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:26.664839 4052 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:26.709980 4052 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:44923
I20260812 11:15:26.710053 4273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:44923 every 8 connection(s)
I20260812 11:15:26.711560 4052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:15:26.719477 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 4052
I20260812 11:15:26.719669 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:15:26.720396 4201 external_mini_cluster.cc:1428] Setting key 3aafd5755efac64bd8ae766167d23124
I20260812 11:15:26.728945 4277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:26.714672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:45287 (local address 127.4.26.126:46077)
0812 11:15:26.721566 (+ 6894us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:26.721570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:26.721588 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:15:26.721646 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:26.721649 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:26.721713 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:26.721821 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:26.723393 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.724341 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.726099 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.726519 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.726641 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:26.728062 (+ 1421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:26.728067 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:26.728070 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:26.728090 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:26.728132 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:26.728145 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:26.728219 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:26.728442 (+ 223us) server_negotiation.cc:299] Negotiation successful
0812 11:15:26.728546 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6777,"thread_start_us":6640,"threads_started":1}
I20260812 11:15:26.730258 4279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:26.715451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:46077 (local address 127.4.26.67:45287)
0812 11:15:26.716774 (+ 1323us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:26.716822 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:26.719265 (+ 2443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:26.722147 (+ 2882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:26.722157 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:26.722266 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:26.723159 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:26.723190 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.724543 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.724548 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:26.725944 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:26.725959 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.726754 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.726763 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:26.727015 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:26.727715 (+ 700us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:15:26.727718 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:26.727765 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:15:26.727852 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:26.728234 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:26.728246 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:26.728254 (+ 8us) client_negotiation.cc:769] Sending connection context
0812 11:15:26.728422 (+ 168us) client_negotiation.cc:240] Negotiation successful
0812 11:15:26.728859 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":408,"threads_started":1}
I20260812 11:15:26.731901 4274 heartbeater.cc:347] Connected to a master server at 127.4.26.126:46077
I20260812 11:15:26.732276 4274 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:26.733141 4274 heartbeater.cc:511] Master 127.4.26.126:46077 requested a full tablet report, sending...
I20260812 11:15:26.734725 3520 ts_manager.cc:194] Registered new tserver with Master: c728e52f2f314fa09672c6331d40cb84 (127.4.26.67:44923)
I20260812 11:15:26.735695 3520 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.26.67:45287
I20260812 11:15:26.736384 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:15:26.741564 3839 heartbeater.cc:503] Master 127.4.26.126:46077 was elected leader, sending a full tablet report...
I20260812 11:15:26.746824 4277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:26.740474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41852 (local address 127.4.26.126:46077)
0812 11:15:26.740676 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:26.740682 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:26.741051 (+ 369us) server_negotiation.cc:407] Connection header received
0812 11:15:26.741212 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:26.741216 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:26.741309 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:26.741386 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:26.741982 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.742967 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.744525 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.744950 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.745055 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:26.746186 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:26.746191 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:26.746194 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:26.746212 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:26.746244 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:26.746255 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:26.746363 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:26.746474 (+ 111us) server_negotiation.cc:299] Negotiation successful
0812 11:15:26.746516 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:15:26.750550 3520 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41852:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:15:26.757678 3520 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:15:26.779115 4294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:26.770967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60700 (local address 127.4.26.66:46673)
0812 11:15:26.772452 (+ 1485us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:26.772458 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:26.772484 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:15:26.772571 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:26.772577 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:26.772816 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:26.773765 (+ 949us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:26.773954 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.774944 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.776905 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.777911 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.778044 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:26.778339 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:26.778593 (+ 254us) server_negotiation.cc:299] Negotiation successful
0812 11:15:26.778775 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1345,"thread_start_us":1226,"threads_started":1}
I20260812 11:15:26.779089 4293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:26.770690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:46673 (local address 127.0.0.1:60700)
0812 11:15:26.771669 (+ 979us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:26.771719 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:26.771905 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:26.773085 (+ 1180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:26.773104 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:26.773146 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:26.773600 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:26.773612 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.775088 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.775093 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:26.776706 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:26.776721 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.778126 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.778134 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:26.778350 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:26.778412 (+ 62us) client_negotiation.cc:769] Sending connection context
0812 11:15:26.778530 (+ 118us) client_negotiation.cc:240] Negotiation successful
0812 11:15:26.778744 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"thread_start_us":466,"threads_started":1}
I20260812 11:15:26.786216 3952 tablet_service.cc:1467] Processing CreateTablet for tablet 47784cc1f7d145e49dc203abf05933be (DEFAULT_TABLE table=test-table [id=75e24e0d89e04a8badc6c12fad79ad5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:26.787912 3952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47784cc1f7d145e49dc203abf05933be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:26.789852 4293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:26.771179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45311 (local address 127.0.0.1:50012)
0812 11:15:26.779383 (+ 8204us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:26.779403 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:26.779494 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:26.783900 (+ 4406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:26.783905 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:26.783935 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:26.784162 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:26.784175 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.785862 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.785867 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:26.787588 (+ 1721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:26.787601 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.788980 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.788986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:26.789208 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:26.789244 (+ 36us) client_negotiation.cc:769] Sending connection context
0812 11:15:26.789357 (+ 113us) client_negotiation.cc:240] Negotiation successful
0812 11:15:26.789510 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8081,"thread_start_us":11015,"threads_started":1}
I20260812 11:15:26.789909 4297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:26.771802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50012 (local address 127.4.26.65:45311)
0812 11:15:26.783264 (+ 11462us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:26.783274 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:26.783310 (+ 36us) server_negotiation.cc:407] Connection header received
0812 11:15:26.783425 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:26.783433 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:26.783696 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:26.783900 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:26.784317 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.785682 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.787776 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.788809 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.788948 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:26.789278 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:26.789402 (+ 124us) server_negotiation.cc:299] Negotiation successful
0812 11:15:26.789573 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10820,"thread_start_us":11020,"threads_started":1}
I20260812 11:15:26.790968 4301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:26.771994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:44923 (local address 127.0.0.1:49170)
0812 11:15:26.781313 (+ 9319us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:26.781335 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:26.781484 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:26.782467 (+ 983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:26.782472 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:26.782503 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:26.782875 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:26.782888 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.784942 (+ 2054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.784947 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:26.787868 (+ 2921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:26.787884 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.790160 (+ 2276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.790167 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:26.790348 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:26.790380 (+ 32us) client_negotiation.cc:769] Sending connection context
0812 11:15:26.790479 (+ 99us) client_negotiation.cc:240] Negotiation successful
0812 11:15:26.790626 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9173,"thread_start_us":9586,"threads_started":1}
I20260812 11:15:26.791201 4304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:26.772567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49170 (local address 127.4.26.67:44923)
0812 11:15:26.773395 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:26.773403 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:26.781471 (+ 8068us) server_negotiation.cc:407] Connection header received
0812 11:15:26.781640 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:26.781647 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:26.781877 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:26.782105 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:26.783175 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.784793 (+ 1618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.788149 (+ 3356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:26.789619 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:26.789759 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:26.790024 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:26.790579 (+ 555us) server_negotiation.cc:299] Negotiation successful
0812 11:15:26.790762 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":645,"thread_start_us":430,"threads_started":1}
I20260812 11:15:26.795564 4158 tablet_service.cc:1467] Processing CreateTablet for tablet 47784cc1f7d145e49dc203abf05933be (DEFAULT_TABLE table=test-table [id=75e24e0d89e04a8badc6c12fad79ad5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:26.795564 3733 tablet_service.cc:1467] Processing CreateTablet for tablet 47784cc1f7d145e49dc203abf05933be (DEFAULT_TABLE table=test-table [id=75e24e0d89e04a8badc6c12fad79ad5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:26.797303 3733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47784cc1f7d145e49dc203abf05933be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:26.797308 4158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47784cc1f7d145e49dc203abf05933be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:26.802896 4305 tablet_bootstrap.cc:492] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394: Bootstrap starting.
I20260812 11:15:26.806370 4305 tablet_bootstrap.cc:654] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:26.807724 4305 log.cc:824] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:26.811095 4305 tablet_bootstrap.cc:492] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394: No bootstrap required, opened a new log
I20260812 11:15:26.811378 4305 ts_tablet_manager.cc:1397] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260812 11:15:26.812810 4309 tablet_bootstrap.cc:492] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84: Bootstrap starting.
I20260812 11:15:26.813714 4308 tablet_bootstrap.cc:492] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff: Bootstrap starting.
I20260812 11:15:26.817692 4308 tablet_bootstrap.cc:654] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:26.819057 4308 log.cc:824] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:26.820668 4309 tablet_bootstrap.cc:654] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:26.821442 4305 raft_consensus.cc:348] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe45dfb6e0a4e8c9031af6b80380394" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46673 } } peers { permanent_uuid: "c728e52f2f314fa09672c6331d40cb84" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44923 } } peers { permanent_uuid: "5d8c770f02a0440db3651e231ccfbcff" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45311 } }
I20260812 11:15:26.821797 4309 log.cc:824] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:26.821938 4305 raft_consensus.cc:374] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:26.822099 4305 raft_consensus.cc:729] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbe45dfb6e0a4e8c9031af6b80380394, State: Initialized, Role: FOLLOWER
I20260812 11:15:26.822800 4308 tablet_bootstrap.cc:492] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff: No bootstrap required, opened a new log
I20260812 11:15:26.823105 4308 ts_tablet_manager.cc:1397] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260812 11:15:26.822914 4305 consensus_queue.cc:260] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe45dfb6e0a4e8c9031af6b80380394" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46673 } } peers { permanent_uuid: "c728e52f2f314fa09672c6331d40cb84" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44923 } } peers { permanent_uuid: "5d8c770f02a0440db3651e231ccfbcff" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45311 } }
I20260812 11:15:26.825131 4309 tablet_bootstrap.cc:492] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84: No bootstrap required, opened a new log
I20260812 11:15:26.825459 4309 ts_tablet_manager.cc:1397] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.002s
I20260812 11:15:26.829967 4048 heartbeater.cc:503] Master 127.4.26.126:46077 was elected leader, sending a full tablet report...
I20260812 11:15:26.830760 4305 ts_tablet_manager.cc:1428] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394: Time spent starting tablet: real 0.019s user 0.008s sys 0.012s
I20260812 11:15:26.833130 4308 raft_consensus.cc:348] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe45dfb6e0a4e8c9031af6b80380394" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46673 } } peers { permanent_uuid: "c728e52f2f314fa09672c6331d40cb84" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44923 } } peers { permanent_uuid: "5d8c770f02a0440db3651e231ccfbcff" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45311 } }
I20260812 11:15:26.833613 4308 raft_consensus.cc:374] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:26.833729 4308 raft_consensus.cc:729] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d8c770f02a0440db3651e231ccfbcff, State: Initialized, Role: FOLLOWER
I20260812 11:15:26.834374 4308 consensus_queue.cc:260] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe45dfb6e0a4e8c9031af6b80380394" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46673 } } peers { permanent_uuid: "c728e52f2f314fa09672c6331d40cb84" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44923 } } peers { permanent_uuid: "5d8c770f02a0440db3651e231ccfbcff" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45311 } }
I20260812 11:15:26.836213 4308 ts_tablet_manager.cc:1428] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff: Time spent starting tablet: real 0.013s user 0.010s sys 0.004s
I20260812 11:15:26.837406 4309 raft_consensus.cc:348] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe45dfb6e0a4e8c9031af6b80380394" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46673 } } peers { permanent_uuid: "c728e52f2f314fa09672c6331d40cb84" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44923 } } peers { permanent_uuid: "5d8c770f02a0440db3651e231ccfbcff" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45311 } }
I20260812 11:15:26.837908 4309 raft_consensus.cc:374] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:26.838003 4309 raft_consensus.cc:729] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c728e52f2f314fa09672c6331d40cb84, State: Initialized, Role: FOLLOWER
I20260812 11:15:26.838622 4309 consensus_queue.cc:260] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe45dfb6e0a4e8c9031af6b80380394" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46673 } } peers { permanent_uuid: "c728e52f2f314fa09672c6331d40cb84" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44923 } } peers { permanent_uuid: "5d8c770f02a0440db3651e231ccfbcff" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45311 } }
I20260812 11:15:26.839818 4274 heartbeater.cc:503] Master 127.4.26.126:46077 was elected leader, sending a full tablet report...
I20260812 11:15:26.840389 4309 ts_tablet_manager.cc:1428] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84: Time spent starting tablet: real 0.015s user 0.009s sys 0.002s
W20260812 11:15:26.950568 4049 tablet.cc:2369] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:15:26.963469 4275 tablet.cc:2369] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:15:26.969466 3844 tablet.cc:2369] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:15:27.004421 4323 raft_consensus.cc:482] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:15:27.004794 4323 raft_consensus.cc:504] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe45dfb6e0a4e8c9031af6b80380394" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46673 } } peers { permanent_uuid: "c728e52f2f314fa09672c6331d40cb84" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44923 } } peers { permanent_uuid: "5d8c770f02a0440db3651e231ccfbcff" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45311 } }
I20260812 11:15:27.006670 4323 leader_election.cc:288] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbe45dfb6e0a4e8c9031af6b80380394 (127.4.26.66:46673), 5d8c770f02a0440db3651e231ccfbcff (127.4.26.65:45311)
I20260812 11:15:27.013686 4294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:27.007125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:42629 (local address 127.4.26.66:46673)
0812 11:15:27.007330 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:27.007337 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:27.007622 (+ 285us) server_negotiation.cc:407] Connection header received
0812 11:15:27.007940 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:27.007946 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:27.008046 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:27.008142 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:27.008697 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:27.009724 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:27.011705 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:27.012712 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:27.012815 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:27.012897 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:27.013291 (+ 394us) server_negotiation.cc:299] Negotiation successful
0812 11:15:27.013397 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:15:27.013727 4279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:27.006960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:46673 (local address 127.4.26.67:42629)
0812 11:15:27.007459 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:27.007522 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:27.007722 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:27.008238 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:27.008244 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:27.008277 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:27.008510 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:27.008525 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:27.009893 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:27.009899 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:27.011519 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:27.011534 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:27.012887 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:27.012894 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:27.013075 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:27.013114 (+ 39us) client_negotiation.cc:769] Sending connection context
0812 11:15:27.013261 (+ 147us) client_negotiation.cc:240] Negotiation successful
0812 11:15:27.013426 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364}
I20260812 11:15:27.014365 4297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:27.007194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:47573 (local address 127.4.26.65:45311)
0812 11:15:27.007448 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:27.007454 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:27.008194 (+ 740us) server_negotiation.cc:407] Connection header received
0812 11:15:27.008291 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:27.008295 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:27.008385 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:27.008504 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:27.009393 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:27.010338 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:27.012391 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:27.013458 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:27.013588 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:27.013695 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:27.014054 (+ 359us) server_negotiation.cc:299] Negotiation successful
0812 11:15:27.014186 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260812 11:15:27.014499 4325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:27.007131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45311 (local address 127.4.26.67:47573)
0812 11:15:27.007989 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:27.008009 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:27.008153 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:27.008558 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:27.008562 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:27.008586 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:27.009131 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:27.009174 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:27.010532 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:27.010536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:27.012156 (+ 1620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:27.012172 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:27.013646 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:27.013652 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:27.013831 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:27.013864 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 11:15:27.014001 (+ 137us) client_negotiation.cc:240] Negotiation successful
0812 11:15:27.014161 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"mutex_wait_us":1,"thread_start_us":459,"threads_started":1}
I20260812 11:15:27.014971 3982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47784cc1f7d145e49dc203abf05933be" candidate_uuid: "c728e52f2f314fa09672c6331d40cb84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe45dfb6e0a4e8c9031af6b80380394" is_pre_election: true
I20260812 11:15:27.015483 3982 raft_consensus.cc:2454] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c728e52f2f314fa09672c6331d40cb84 in term 0.
I20260812 11:15:27.015424 3766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47784cc1f7d145e49dc203abf05933be" candidate_uuid: "c728e52f2f314fa09672c6331d40cb84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8c770f02a0440db3651e231ccfbcff" is_pre_election: true
I20260812 11:15:27.015888 3766 raft_consensus.cc:2454] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c728e52f2f314fa09672c6331d40cb84 in term 0.
I20260812 11:15:27.016172 4084 leader_election.cc:302] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe45dfb6e0a4e8c9031af6b80380394, c728e52f2f314fa09672c6331d40cb84; no voters:
I20260812 11:15:27.016551 4323 raft_consensus.cc:2781] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:15:27.016742 4323 raft_consensus.cc:482] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:15:27.016849 4323 raft_consensus.cc:3037] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:27.019099 4323 raft_consensus.cc:504] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe45dfb6e0a4e8c9031af6b80380394" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46673 } } peers { permanent_uuid: "c728e52f2f314fa09672c6331d40cb84" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44923 } } peers { permanent_uuid: "5d8c770f02a0440db3651e231ccfbcff" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45311 } }
I20260812 11:15:27.019763 4323 leader_election.cc:288] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [CANDIDATE]: Term 1 election: Requested vote from peers bbe45dfb6e0a4e8c9031af6b80380394 (127.4.26.66:46673), 5d8c770f02a0440db3651e231ccfbcff (127.4.26.65:45311)
I20260812 11:15:27.020264 3982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47784cc1f7d145e49dc203abf05933be" candidate_uuid: "c728e52f2f314fa09672c6331d40cb84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbe45dfb6e0a4e8c9031af6b80380394"
I20260812 11:15:27.020344 3766 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47784cc1f7d145e49dc203abf05933be" candidate_uuid: "c728e52f2f314fa09672c6331d40cb84" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d8c770f02a0440db3651e231ccfbcff"
I20260812 11:15:27.020466 3982 raft_consensus.cc:3037] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:27.020550 3766 raft_consensus.cc:3037] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:27.022933 3766 raft_consensus.cc:2454] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728e52f2f314fa09672c6331d40cb84 in term 1.
I20260812 11:15:27.022971 3982 raft_consensus.cc:2454] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c728e52f2f314fa09672c6331d40cb84 in term 1.
I20260812 11:15:27.023455 4084 leader_election.cc:302] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbe45dfb6e0a4e8c9031af6b80380394, c728e52f2f314fa09672c6331d40cb84; no voters:
I20260812 11:15:27.023855 4323 raft_consensus.cc:2781] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:27.024394 4323 raft_consensus.cc:686] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [term 1 LEADER]: Becoming Leader. State: Replica: c728e52f2f314fa09672c6331d40cb84, State: Running, Role: LEADER
I20260812 11:15:27.024921 4323 consensus_queue.cc:237] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe45dfb6e0a4e8c9031af6b80380394" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46673 } } peers { permanent_uuid: "c728e52f2f314fa09672c6331d40cb84" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44923 } } peers { permanent_uuid: "5d8c770f02a0440db3651e231ccfbcff" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45311 } }
I20260812 11:15:27.030057 3520 catalog_manager.cc:5495] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 reported cstate change: term changed from 0 to 1, leader changed from <none> to c728e52f2f314fa09672c6331d40cb84 (127.4.26.67). New cstate: current_term: 1 leader_uuid: "c728e52f2f314fa09672c6331d40cb84" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbe45dfb6e0a4e8c9031af6b80380394" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c728e52f2f314fa09672c6331d40cb84" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 44923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d8c770f02a0440db3651e231ccfbcff" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45311 } health_report { overall_health: UNKNOWN } } }
I20260812 11:15:27.095498 4304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:27.089916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49180 (local address 127.4.26.67:44923)
0812 11:15:27.090132 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:27.090138 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:27.090173 (+ 35us) server_negotiation.cc:407] Connection header received
0812 11:15:27.090276 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:27.090279 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:27.090361 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:27.090506 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:15:27.090921 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:27.091713 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:27.093209 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:27.093639 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:27.093757 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:27.094390 (+ 633us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:15:27.094910 (+ 520us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:15:27.095103 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:27.095223 (+ 120us) server_negotiation.cc:299] Negotiation successful
0812 11:15:27.095269 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:15:27.104192 3766 raft_consensus.cc:1261] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff [term 1 FOLLOWER]: Refusing update from remote peer c728e52f2f314fa09672c6331d40cb84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:15:27.104199 3982 raft_consensus.cc:1261] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394 [term 1 FOLLOWER]: Refusing update from remote peer c728e52f2f314fa09672c6331d40cb84: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:15:27.105229 4326 consensus_queue.cc:1035] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d8c770f02a0440db3651e231ccfbcff" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:15:27.105640 4323 consensus_queue.cc:1035] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbe45dfb6e0a4e8c9031af6b80380394" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 46673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:15:27.119660 4333 mvcc.cc:205] Tried to move back new op lower bound from 7317640507808911360 to 7317640507498287104. Current Snapshot: MvccSnapshot[applied={T|T < 7317640507808911360}]
I20260812 11:15:27.121896 4334 mvcc.cc:205] Tried to move back new op lower bound from 7317640507808911360 to 7317640507498287104. Current Snapshot: MvccSnapshot[applied={T|T < 7317640507808911360}]
I20260812 11:15:27.132395 3518 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:15:27.132689 3518 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:15:27.136726 3518 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 84cd77edf20246e8a7bad4b0489fb813: Sending DeleteTablet for 3 replicas of tablet 47784cc1f7d145e49dc203abf05933be
I20260812 11:15:27.138198 3952 tablet_service.cc:1514] Processing DeleteTablet for tablet 47784cc1f7d145e49dc203abf05933be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:27 UTC) from {username='slave'} at 127.0.0.1:60700
I20260812 11:15:27.138339 4158 tablet_service.cc:1514] Processing DeleteTablet for tablet 47784cc1f7d145e49dc203abf05933be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:27 UTC) from {username='slave'} at 127.0.0.1:49170
I20260812 11:15:27.138667 3733 tablet_service.cc:1514] Processing DeleteTablet for tablet 47784cc1f7d145e49dc203abf05933be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:27 UTC) from {username='slave'} at 127.0.0.1:50012
I20260812 11:15:27.139621 4349 tablet_replica.cc:330] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394: stopping tablet replica
I20260812 11:15:27.140174 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 3619
I20260812 11:15:27.140215 4349 raft_consensus.cc:2229] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:15:27.140810 4349 raft_consensus.cc:2258] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:15:27.141691 4346 tablet_replica.cc:330] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84: stopping tablet replica
I20260812 11:15:27.142148 4346 raft_consensus.cc:2229] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:15:27.142815 4346 raft_consensus.cc:2258] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:15:27.143635 4349 ts_tablet_manager.cc:1905] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:15:27.151104 4349 ts_tablet_manager.cc:1918] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:27.151811 4350 tablet_replica.cc:330] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff: stopping tablet replica
I20260812 11:15:27.152406 4350 raft_consensus.cc:2229] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:15:27.153074 4350 raft_consensus.cc:2258] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:15:27.153540 4346 ts_tablet_manager.cc:1905] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:15:27.155493 4350 ts_tablet_manager.cc:1905] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:15:27.162845 4350 ts_tablet_manager.cc:1918] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:27.163256 4349 log.cc:1196] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/47784cc1f7d145e49dc203abf05933be
I20260812 11:15:27.163998 4349 ts_tablet_manager.cc:1939] T 47784cc1f7d145e49dc203abf05933be P bbe45dfb6e0a4e8c9031af6b80380394: Deleting consensus metadata
I20260812 11:15:27.166328 3491 catalog_manager.cc:4841] TS bbe45dfb6e0a4e8c9031af6b80380394 (127.4.26.66:46673): tablet 47784cc1f7d145e49dc203abf05933be (table test-table [id=75e24e0d89e04a8badc6c12fad79ad5d]) successfully deleted
I20260812 11:15:27.165956 4297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:27.142965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50028 (local address 127.4.26.65:45311)
0812 11:15:27.143175 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:27.143181 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:27.147922 (+ 4741us) server_negotiation.cc:407] Connection header received
0812 11:15:27.148114 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:27.148120 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:27.148238 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:27.148360 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:27.149035 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:27.150209 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:27.161355 (+ 11146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:27.162076 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:27.162199 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:27.163974 (+ 1775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:27.163988 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:27.164009 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:27.164890 (+ 881us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:27.164956 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:27.164987 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:27.165106 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:27.165473 (+ 367us) server_negotiation.cc:299] Negotiation successful
0812 11:15:27.165609 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:15:27.167052 4346 ts_tablet_manager.cc:1918] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:27.167286 4346 log.cc:1196] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/47784cc1f7d145e49dc203abf05933be
I20260812 11:15:27.167771 3828 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:27.167862 4346 ts_tablet_manager.cc:1939] T 47784cc1f7d145e49dc203abf05933be P c728e52f2f314fa09672c6331d40cb84: Deleting consensus metadata
I20260812 11:15:27.167809 4350 log.cc:1196] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/47784cc1f7d145e49dc203abf05933be
I20260812 11:15:27.169636 3491 catalog_manager.cc:4841] TS c728e52f2f314fa09672c6331d40cb84 (127.4.26.67:44923): tablet 47784cc1f7d145e49dc203abf05933be (table test-table [id=75e24e0d89e04a8badc6c12fad79ad5d]) successfully deleted
I20260812 11:15:27.282945 4350 ts_tablet_manager.cc:1939] T 47784cc1f7d145e49dc203abf05933be P 5d8c770f02a0440db3651e231ccfbcff: Deleting consensus metadata
I20260812 11:15:27.282989 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 3619
I20260812 11:15:27.306542 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 3847
W20260812 11:15:27.306674 3488 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.26.65:45311 (error 108)
I20260812 11:15:27.309528 4355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:27.308167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45311 (local address 127.0.0.1:50044)
0812 11:15:27.309094 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:27.309286 (+ 192us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":768,"thread_start_us":645,"threads_started":1}
W20260812 11:15:27.309828 3488 catalog_manager.cc:4584] TS 5d8c770f02a0440db3651e231ccfbcff (127.4.26.65:45311): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 47784cc1f7d145e49dc203abf05933be: Network error: Client connection negotiation failed: client connection to 127.4.26.65:45311: connect: Connection refused (error 111)
I20260812 11:15:27.315160 4294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:27.307425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60714 (local address 127.4.26.66:46673)
0812 11:15:27.307622 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:27.307627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:27.307650 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:15:27.308343 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:27.308349 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:27.308452 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:27.308547 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:27.309088 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:27.310281 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:27.311582 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:27.312255 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:27.312396 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:27.313421 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:27.313433 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:27.313455 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:27.314292 (+ 837us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:27.314360 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:27.314396 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:27.314528 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:27.314655 (+ 127us) server_negotiation.cc:299] Negotiation successful
0812 11:15:27.314776 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 11:15:27.316028 4039 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:27.363606 4355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:27.363004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45311 (local address 127.0.0.1:50058)
0812 11:15:27.363307 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:27.363421 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260812 11:15:27.364916 4355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:27.364455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45311 (local address 127.0.0.1:50060)
0812 11:15:27.364620 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:27.364717 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260812 11:15:27.407137 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 3847
I20260812 11:15:27.425487 4355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:27.424882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45311 (local address 127.0.0.1:50074)
0812 11:15:27.425139 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:27.425293 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260812 11:15:27.426870 4355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:27.426342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45311 (local address 127.0.0.1:50086)
0812 11:15:27.426531 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:27.426655 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260812 11:15:27.434499 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 4052
I20260812 11:15:27.447386 4304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:27.435429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49192 (local address 127.4.26.67:44923)
0812 11:15:27.435643 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:27.435651 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:27.435675 (+ 24us) server_negotiation.cc:407] Connection header received
0812 11:15:27.435743 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:27.435750 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:27.435883 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:27.436040 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:27.436414 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:27.437661 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:27.438997 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:27.439674 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:27.439815 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:27.445527 (+ 5712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:27.445542 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:27.445566 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:27.446464 (+ 898us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:27.446551 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:27.446585 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:27.446724 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:27.446854 (+ 130us) server_negotiation.cc:299] Negotiation successful
0812 11:15:27.446993 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 11:15:27.448233 4265 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:27.507474 4355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:27.506932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45311 (local address 127.0.0.1:50100)
0812 11:15:27.507197 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:27.507320 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260812 11:15:27.508697 4355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:27.508170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:45311 (local address 127.0.0.1:50110)
0812 11:15:27.508415 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:27.508533 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.65:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260812 11:15:27.573346 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 4052
I20260812 11:15:27.602216 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 3458
I20260812 11:15:27.603339 3569 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:27.713429 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 3458
2026-08-12T11:15:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3142 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:15:27 dist-test-slave-rmhg krb5kdc[4363](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:15:27 dist-test-slave-rmhg krb5kdc[4363](info): set up 2 sockets
Aug 12 11:15:27 dist-test-slave-rmhg krb5kdc[4363](info): commencing operation
krb5kdc: starting...
W20260812 11:15:29.399698 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.634s user 0.000s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:15:29 dist-test-slave-rmhg krb5kdc[4363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:15:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:15:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:15:29.905715 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:34703
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:41151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:34703
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:30.313663 4383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:30.314005 4383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:30.314105 4383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:30.321815 4383 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:15:30.321957 4383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:30.322005 4383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:30.322062 4383 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:15:30.322105 4383 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:15:30.332676 4383 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:41151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:34703
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:34703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:30.334121 4383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:30.335505 4383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:30.347595 4399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:30.347719 4394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:30.347668 4396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:30.348384 4383 server_base.cc:1034] running on GCE node
I20260812 11:15:30.349313 4383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:30.350817 4383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:30.352030 4383 hybrid_clock.cc:648] HybridClock initialized: now 1786533330351971 us; error 55 us; skew 500 ppm
I20260812 11:15:30.352396 4383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:30 dist-test-slave-rmhg krb5kdc[4363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533330, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:30.355633 4383 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:15:30.357358 4383 webserver.cc:460] Webserver started at http://127.4.26.126:41721/ using document root <none> and password file <none>
I20260812 11:15:30.358086 4383 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:30.358225 4383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:30.358542 4383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:30.361812 4383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "4d7e6966ed9e4cfcbfca3dab3f11d99d"
format_stamp: "Formatted at 2026-08-12 11:15:30 on dist-test-slave-rmhg"
server_key: "01252f01c847c747866da637b4119960"
server_key_iv: "ea8d74e990a8fa3b54b658c6d42ea63b"
server_key_version: "encryptionkey@0"
I20260812 11:15:30.362638 4383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "4d7e6966ed9e4cfcbfca3dab3f11d99d"
format_stamp: "Formatted at 2026-08-12 11:15:30 on dist-test-slave-rmhg"
server_key: "01252f01c847c747866da637b4119960"
server_key_iv: "ea8d74e990a8fa3b54b658c6d42ea63b"
server_key_version: "encryptionkey@0"
I20260812 11:15:30.368250 4383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:15:30.372140 4411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:30.373589 4383 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:15:30.373816 4383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "4d7e6966ed9e4cfcbfca3dab3f11d99d"
format_stamp: "Formatted at 2026-08-12 11:15:30 on dist-test-slave-rmhg"
server_key: "01252f01c847c747866da637b4119960"
server_key_iv: "ea8d74e990a8fa3b54b658c6d42ea63b"
server_key_version: "encryptionkey@0"
I20260812 11:15:30.374019 4383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:30.389034 4383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:30.393895 4383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:30.394232 4383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:30.412992 4383 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:34703
I20260812 11:15:30.412999 4498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:34703 every 8 connection(s)
I20260812 11:15:30.414670 4383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:15:30.419034 4504 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:30.422292 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 4383
I20260812 11:15:30.422461 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:15:30.422945 4201 external_mini_cluster.cc:1428] Setting key 2b0f052be26ded6dac478c1d9e3bb34a
I20260812 11:15:30.432156 4504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d: Bootstrap starting.
I20260812 11:15:30.436432 4504 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:30.438165 4504 log.cc:824] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:15:30 dist-test-slave-rmhg krb5kdc[4363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:15:30.442040 4504 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d: No bootstrap required, opened a new log
I20260812 11:15:30.449745 4510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:30.425027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36672 (local address 127.4.26.126:34703)
0812 11:15:30.425882 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:30.425894 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:30.425939 (+ 45us) server_negotiation.cc:407] Connection header received
0812 11:15:30.427728 (+ 1789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:30.427756 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:30.428227 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:30.428586 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:30.430634 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:30.432078 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:30.434002 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:30.434806 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:30.434961 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:30.440844 (+ 5883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:30.440854 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:30.440873 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:30.440915 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:30.444204 (+ 3289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:30.445314 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:30.445324 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:30.445335 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:30.445614 (+ 279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:30.446165 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:30.446199 (+ 34us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:30.446201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:30.446944 (+ 743us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:30.447236 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:30.447841 (+ 605us) server_negotiation.cc:299] Negotiation successful
0812 11:15:30.448353 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":354,"threads_started":1}
I20260812 11:15:30.451426 4504 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7e6966ed9e4cfcbfca3dab3f11d99d" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34703 } }
I20260812 11:15:30.451953 4504 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:30.452071 4504 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7e6966ed9e4cfcbfca3dab3f11d99d, State: Initialized, Role: FOLLOWER
I20260812 11:15:30.452776 4504 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7e6966ed9e4cfcbfca3dab3f11d99d" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34703 } }
I20260812 11:15:30.453100 4504 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:15:30.453287 4504 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:15:30.453465 4504 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:30.455709 4504 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7e6966ed9e4cfcbfca3dab3f11d99d" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34703 } }
I20260812 11:15:30.456212 4504 leader_election.cc:302] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d7e6966ed9e4cfcbfca3dab3f11d99d; no voters:
I20260812 11:15:30.456792 4504 leader_election.cc:288] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:15:30.456938 4513 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:30.458210 4513 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [term 1 LEADER]: Becoming Leader. State: Replica: 4d7e6966ed9e4cfcbfca3dab3f11d99d, State: Running, Role: LEADER
I20260812 11:15:30.458910 4513 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7e6966ed9e4cfcbfca3dab3f11d99d" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34703 } }
I20260812 11:15:30.459239 4504 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:15:30.461906 4515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d7e6966ed9e4cfcbfca3dab3f11d99d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7e6966ed9e4cfcbfca3dab3f11d99d" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34703 } } }
I20260812 11:15:30.461941 4516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d7e6966ed9e4cfcbfca3dab3f11d99d. Latest consensus state: current_term: 1 leader_uuid: "4d7e6966ed9e4cfcbfca3dab3f11d99d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7e6966ed9e4cfcbfca3dab3f11d99d" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34703 } } }
I20260812 11:15:30.462388 4515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:30.462400 4516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:30.463296 4525 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:15:30.469951 4525 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:15:30.480358 4525 catalog_manager.cc:1347] Generated new cluster ID: a2f352e7a1ad44ffac267f4072cef26d
I20260812 11:15:30.480509 4525 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:15:30.522547 4525 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:15:30.524600 4525 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:15:30.535792 4525 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d: Generated new TSK 0
I20260812 11:15:30.536972 4525 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.26.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
Entry for principal kudu/127.4.26.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab.
I20260812 11:15:30.618325 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:34703
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:41151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:30.973862 4543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:30.974166 4543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:30.974261 4543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:30.981714 4543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:30.981839 4543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:30.981963 4543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:15:30.992118 4543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:41151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.65.keytab
--principal=kudu/127.4.26.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:34703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:30.993534 4543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:30.994832 4543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:31.008208 4553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:31.008172 4551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:31.008242 4550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:31.009105 4543 server_base.cc:1034] running on GCE node
I20260812 11:15:31.009780 4543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:31.010705 4543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:31.011940 4543 hybrid_clock.cc:648] HybridClock initialized: now 1786533331011886 us; error 39 us; skew 500 ppm
I20260812 11:15:31.012341 4543 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:31 dist-test-slave-rmhg krb5kdc[4363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533331, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:31.015762 4543 init.cc:377] Logged in from keytab as kudu/127.4.26.65@KRBTEST.COM (short username kudu)
I20260812 11:15:31.017408 4543 webserver.cc:460] Webserver started at http://127.4.26.65:42915/ using document root <none> and password file <none>
I20260812 11:15:31.018373 4543 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:31.018517 4543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:31.018844 4543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:31.022053 4543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "61a8a8b3a46e44a8a46a03c89d659965"
format_stamp: "Formatted at 2026-08-12 11:15:31 on dist-test-slave-rmhg"
server_key: "53fbceaf15a84935ebbb7a4c90874db5"
server_key_iv: "7cb38281a458ca915decb93e0b22a4c0"
server_key_version: "encryptionkey@0"
I20260812 11:15:31.022855 4543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "61a8a8b3a46e44a8a46a03c89d659965"
format_stamp: "Formatted at 2026-08-12 11:15:31 on dist-test-slave-rmhg"
server_key: "53fbceaf15a84935ebbb7a4c90874db5"
server_key_iv: "7cb38281a458ca915decb93e0b22a4c0"
server_key_version: "encryptionkey@0"
I20260812 11:15:31.028120 4543 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260812 11:15:31.031677 4561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:31.032982 4543 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260812 11:15:31.033182 4543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "61a8a8b3a46e44a8a46a03c89d659965"
format_stamp: "Formatted at 2026-08-12 11:15:31 on dist-test-slave-rmhg"
server_key: "53fbceaf15a84935ebbb7a4c90874db5"
server_key_iv: "7cb38281a458ca915decb93e0b22a4c0"
server_key_version: "encryptionkey@0"
I20260812 11:15:31.033380 4543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:31.056381 4543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:31.061060 4543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:31.061379 4543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:31.062398 4543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:31.063902 4543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:31.063997 4543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:31.064114 4543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:31.064168 4543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:31.096457 4543 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:39451
I20260812 11:15:31.096529 4752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:39451 every 8 connection(s)
I20260812 11:15:31.097853 4543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:15:31.101293 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 4543
I20260812 11:15:31.101503 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:15:31.102070 4201 external_mini_cluster.cc:1428] Setting key 79d1e4853f82631fc1915066baad679f
Aug 12 11:15:31 dist-test-slave-rmhg krb5kdc[4363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533331, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.65@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:15:31.121068 4757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:31.100393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:58931 (local address 127.4.26.126:34703)
0812 11:15:31.100877 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:31.100884 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:31.102074 (+ 1190us) server_negotiation.cc:407] Connection header received
0812 11:15:31.104248 (+ 2174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:31.104253 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:31.104323 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:31.104411 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:31.106509 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:31.107276 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:31.109407 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:31.109833 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:31.109937 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:31.114406 (+ 4469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:31.114413 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:31.114416 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:31.114458 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:31.117405 (+ 2947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:31.118439 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:31.118445 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:31.118449 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:31.118627 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:31.119072 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:31.119077 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:31.119081 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:31.119483 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:31.119646 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:31.120434 (+ 788us) server_negotiation.cc:299] Negotiation successful
0812 11:15:31.120706 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":233,"threads_started":1}
I20260812 11:15:31.122007 4758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:31.100995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:34703 (local address 127.4.26.65:58931)
0812 11:15:31.101881 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:31.101939 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:31.103976 (+ 2037us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:31.104718 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:31.104731 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:31.105507 (+ 776us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:31.106329 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:31.106355 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:31.107435 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:31.107441 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:31.109264 (+ 1823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:31.109281 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:31.110072 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:31.110078 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:31.110373 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:31.111114 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:15:31.111145 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:31.114045 (+ 2900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:31.117615 (+ 3570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:31.117626 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:31.117648 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:31.118275 (+ 627us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:31.118737 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:31.118740 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:31.118742 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:31.118956 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:31.119632 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:31.119639 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:31.120012 (+ 373us) client_negotiation.cc:769] Sending connection context
0812 11:15:31.120263 (+ 251us) client_negotiation.cc:240] Negotiation successful
0812 11:15:31.120748 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":347,"threads_started":1}
I20260812 11:15:31.123735 4754 heartbeater.cc:347] Connected to a master server at 127.4.26.126:34703
I20260812 11:15:31.124107 4754 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:31.125120 4754 heartbeater.cc:511] Master 127.4.26.126:34703 requested a full tablet report, sending...
I20260812 11:15:31.127540 4440 ts_manager.cc:194] Registered new tserver with Master: 61a8a8b3a46e44a8a46a03c89d659965 (127.4.26.65:39451)
I20260812 11:15:31.129287 4440 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.65@KRBTEST.COM'} at 127.4.26.65:58931
WARNING: no policy specified for kudu/127.4.26.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
Entry for principal kudu/127.4.26.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab.
I20260812 11:15:31.176723 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:34703
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:41151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:31.527166 4762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:31.527451 4762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:31.527546 4762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:31.535295 4762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:31.535434 4762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:31.535578 4762 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:15:31.546118 4762 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:41151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.66.keytab
--principal=kudu/127.4.26.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:34703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:31.547515 4762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:31.548909 4762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:31.562924 4772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:31.562968 4770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:31.562882 4775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:31.563777 4762 server_base.cc:1034] running on GCE node
I20260812 11:15:31.564407 4762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:31.565464 4762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:31.566706 4762 hybrid_clock.cc:648] HybridClock initialized: now 1786533331566651 us; error 44 us; skew 500 ppm
I20260812 11:15:31.567027 4762 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:31 dist-test-slave-rmhg krb5kdc[4363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533331, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:31.570374 4762 init.cc:377] Logged in from keytab as kudu/127.4.26.66@KRBTEST.COM (short username kudu)
I20260812 11:15:31.572088 4762 webserver.cc:460] Webserver started at http://127.4.26.66:44597/ using document root <none> and password file <none>
I20260812 11:15:31.572832 4762 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:31.572958 4762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:31.573343 4762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:31.576462 4762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "bd9bd2c677694471a526fc0ef33a06b3"
format_stamp: "Formatted at 2026-08-12 11:15:31 on dist-test-slave-rmhg"
server_key: "3499a28f745f27317e0cf1b8fa2204a1"
server_key_iv: "f0790fcb8ab1d3bddae79fd3c6cdd7d7"
server_key_version: "encryptionkey@0"
I20260812 11:15:31.577347 4762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "bd9bd2c677694471a526fc0ef33a06b3"
format_stamp: "Formatted at 2026-08-12 11:15:31 on dist-test-slave-rmhg"
server_key: "3499a28f745f27317e0cf1b8fa2204a1"
server_key_iv: "f0790fcb8ab1d3bddae79fd3c6cdd7d7"
server_key_version: "encryptionkey@0"
I20260812 11:15:31.582954 4762 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 11:15:31.586742 4788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:31.588191 4762 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:15:31.588356 4762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "bd9bd2c677694471a526fc0ef33a06b3"
format_stamp: "Formatted at 2026-08-12 11:15:31 on dist-test-slave-rmhg"
server_key: "3499a28f745f27317e0cf1b8fa2204a1"
server_key_iv: "f0790fcb8ab1d3bddae79fd3c6cdd7d7"
server_key_version: "encryptionkey@0"
I20260812 11:15:31.588563 4762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:31.608796 4762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:31.613507 4762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:31.613826 4762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:31.614881 4762 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:31.616364 4762 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:31.616446 4762 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:31.616572 4762 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:31.616670 4762 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:31.647790 4762 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:33227
I20260812 11:15:31.647836 4985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:33227 every 8 connection(s)
I20260812 11:15:31.649271 4762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:15:31.649601 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 4762
I20260812 11:15:31.649776 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:15:31.650291 4201 external_mini_cluster.cc:1428] Setting key 1eb388a55e750d1b5426db92d0082e8b
Aug 12 11:15:31 dist-test-slave-rmhg krb5kdc[4363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533331, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.66@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:15:31.673094 4991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:31.652250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:47273 (local address 127.4.26.126:34703)
0812 11:15:31.652827 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:31.652834 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:31.653949 (+ 1115us) server_negotiation.cc:407] Connection header received
0812 11:15:31.656430 (+ 2481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:31.656435 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:31.656507 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:31.656607 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:31.658763 (+ 2156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:31.659562 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:31.661751 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:31.662199 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:31.662303 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:31.666887 (+ 4584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:31.666896 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:31.666900 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:31.666951 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:31.669683 (+ 2732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:31.670548 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:31.670552 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:31.670562 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:31.670713 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:31.671186 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:31.671190 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:31.671192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:31.671495 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:31.671648 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:31.672443 (+ 795us) server_negotiation.cc:299] Negotiation successful
0812 11:15:31.672713 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":307,"threads_started":1}
I20260812 11:15:31.674165 4992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:31.652945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:34703 (local address 127.4.26.66:47273)
0812 11:15:31.653773 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:31.653825 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:31.656078 (+ 2253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:31.656916 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:31.656928 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:31.657712 (+ 784us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:31.658542 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:31.658570 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:31.659718 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:31.659723 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:31.661588 (+ 1865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:31.661617 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:31.662442 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:31.662449 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:31.662752 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:31.663576 (+ 824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:15:31.663627 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:31.666552 (+ 2925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:31.669862 (+ 3310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:31.669879 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:31.669896 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:31.670389 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:31.670833 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:31.670838 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:31.670842 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:31.671047 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:31.671642 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:31.671652 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:31.672030 (+ 378us) client_negotiation.cc:769] Sending connection context
0812 11:15:31.672305 (+ 275us) client_negotiation.cc:240] Negotiation successful
0812 11:15:31.672888 (+ 583us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":315,"threads_started":1}
I20260812 11:15:31.675683 4987 heartbeater.cc:347] Connected to a master server at 127.4.26.126:34703
I20260812 11:15:31.676033 4987 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:31.676982 4987 heartbeater.cc:511] Master 127.4.26.126:34703 requested a full tablet report, sending...
I20260812 11:15:31.678814 4440 ts_manager.cc:194] Registered new tserver with Master: bd9bd2c677694471a526fc0ef33a06b3 (127.4.26.66:33227)
I20260812 11:15:31.679976 4440 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.66@KRBTEST.COM'} at 127.4.26.66:47273
WARNING: no policy specified for kudu/127.4.26.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
Entry for principal kudu/127.4.26.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab.
I20260812 11:15:31.724311 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:34703
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:41151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:32.084882 4997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:32.085248 4997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:32.085399 4997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:32.093302 4997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:32.093458 4997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:32.093590 4997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:15:32.104660 4997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:41151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.67.keytab
--principal=kudu/127.4.26.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:34703
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:32.106117 4997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:32.107556 4997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:32.121778 5005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:32.121691 5003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:32.121717 5007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:32.122540 4997 server_base.cc:1034] running on GCE node
I20260812 11:15:32.123232 4997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:32.124298 4997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:32.125526 4997 hybrid_clock.cc:648] HybridClock initialized: now 1786533332125469 us; error 50 us; skew 500 ppm
I20260812 11:15:32.125900 4997 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:32 dist-test-slave-rmhg krb5kdc[4363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533332, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:32.129390 4997 init.cc:377] Logged in from keytab as kudu/127.4.26.67@KRBTEST.COM (short username kudu)
I20260812 11:15:32.131004 4997 webserver.cc:460] Webserver started at http://127.4.26.67:35999/ using document root <none> and password file <none>
I20260812 11:15:32.131763 4997 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:32.131892 4997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:32.132227 4997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:32.133316 4754 heartbeater.cc:503] Master 127.4.26.126:34703 was elected leader, sending a full tablet report...
I20260812 11:15:32.135685 4997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "ac79282114c94de889b95e6a685f338d"
format_stamp: "Formatted at 2026-08-12 11:15:32 on dist-test-slave-rmhg"
server_key: "acedcea25839b7e63003901b10f0d1e9"
server_key_iv: "3e14c38c82d84134abbbbdad9337c876"
server_key_version: "encryptionkey@0"
I20260812 11:15:32.136556 4997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "ac79282114c94de889b95e6a685f338d"
format_stamp: "Formatted at 2026-08-12 11:15:32 on dist-test-slave-rmhg"
server_key: "acedcea25839b7e63003901b10f0d1e9"
server_key_iv: "3e14c38c82d84134abbbbdad9337c876"
server_key_version: "encryptionkey@0"
I20260812 11:15:32.142508 4997 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 11:15:32.146353 5021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:32.147855 4997 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:15:32.148029 4997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "ac79282114c94de889b95e6a685f338d"
format_stamp: "Formatted at 2026-08-12 11:15:32 on dist-test-slave-rmhg"
server_key: "acedcea25839b7e63003901b10f0d1e9"
server_key_iv: "3e14c38c82d84134abbbbdad9337c876"
server_key_version: "encryptionkey@0"
I20260812 11:15:32.148245 4997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:32.171741 4997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:32.176635 4997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:32.176944 4997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:32.178074 4997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:32.179632 4997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:32.179729 4997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:32.179859 4997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:32.179914 4997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:32.212103 4997 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:39185
I20260812 11:15:32.212184 5206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:39185 every 8 connection(s)
I20260812 11:15:32.213586 4997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:15:32.218606 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 4997
I20260812 11:15:32.218835 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:15:32.219427 4201 external_mini_cluster.cc:1428] Setting key 86c7e48872139dcc1a29ba313adafbc3
Aug 12 11:15:32 dist-test-slave-rmhg krb5kdc[4363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533332, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.67@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:15:32.236244 5214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:32.216488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:51015 (local address 127.4.26.126:34703)
0812 11:15:32.217004 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:32.217009 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:32.217971 (+ 962us) server_negotiation.cc:407] Connection header received
0812 11:15:32.220778 (+ 2807us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:32.220784 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:32.220874 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:32.220975 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:32.222779 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.223632 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.225452 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.225885 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.226004 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:32.229920 (+ 3916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:32.229926 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:32.229929 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:32.229970 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:32.232534 (+ 2564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:32.233633 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:32.233641 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:32.233644 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:32.233819 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:32.234322 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:32.234326 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:32.234328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:32.234629 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:32.234788 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:32.235595 (+ 807us) server_negotiation.cc:299] Negotiation successful
0812 11:15:32.235852 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":281,"threads_started":1}
I20260812 11:15:32.237383 5215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:32.216966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:34703 (local address 127.4.26.67:51015)
0812 11:15:32.217776 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:32.217830 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:32.220343 (+ 2513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:32.221321 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:32.221332 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:32.221930 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:32.222580 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:32.222601 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.223815 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.223819 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:32.225274 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:32.225290 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.226144 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.226152 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:32.226402 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:32.227135 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:15:32.227163 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:32.229634 (+ 2471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:32.232719 (+ 3085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:32.232728 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:32.232745 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:32.233454 (+ 709us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:32.233951 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:15:32.233956 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:15:32.233960 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:15:32.234190 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:15:32.234789 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:32.234798 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:32.235180 (+ 382us) client_negotiation.cc:769] Sending connection context
0812 11:15:32.235467 (+ 287us) client_negotiation.cc:240] Negotiation successful
0812 11:15:32.236084 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":328,"threads_started":1}
I20260812 11:15:32.238747 5207 heartbeater.cc:347] Connected to a master server at 127.4.26.126:34703
I20260812 11:15:32.239073 5207 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:32.239867 5207 heartbeater.cc:511] Master 127.4.26.126:34703 requested a full tablet report, sending...
I20260812 11:15:32.241523 4440 ts_manager.cc:194] Registered new tserver with Master: ac79282114c94de889b95e6a685f338d (127.4.26.67:39185)
I20260812 11:15:32.242409 4440 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.26.67@KRBTEST.COM'} at 127.4.26.67:51015
I20260812 11:15:32.247836 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:15:32.264817 5214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:32.252086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36686 (local address 127.4.26.126:34703)
0812 11:15:32.252293 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:32.252301 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:32.252727 (+ 426us) server_negotiation.cc:407] Connection header received
0812 11:15:32.252921 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:32.252925 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:32.253008 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:32.253092 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:32.254660 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.255382 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.256668 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.257072 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.257202 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:32.259498 (+ 2296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:32.259503 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:32.259506 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:32.259537 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:32.262192 (+ 2655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:32.262906 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:32.262910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:32.262912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:32.263037 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:32.263351 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:32.263354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:32.263356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:32.263764 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:32.263958 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:32.264311 (+ 353us) server_negotiation.cc:299] Negotiation successful
0812 11:15:32.264509 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260812 11:15:32.269068 4440 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36686:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:15:32.276396 4440 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:15:32.313364 5231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:32.290349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:39185 (local address 127.0.0.1:56034)
0812 11:15:32.296204 (+ 5855us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:32.296277 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:32.296529 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:32.305826 (+ 9297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:32.305836 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:32.305878 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:32.306362 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:32.306381 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.308457 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.308462 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:32.310435 (+ 1973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:32.310449 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.312215 (+ 1766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.312222 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:32.312453 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:32.312531 (+ 78us) client_negotiation.cc:769] Sending connection context
0812 11:15:32.312653 (+ 122us) client_negotiation.cc:240] Negotiation successful
0812 11:15:32.312864 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5502,"mutex_wait_us":6,"thread_start_us":5257,"threads_started":1}
I20260812 11:15:32.313977 5237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:32.297105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36718 (local address 127.4.26.66:33227)
0812 11:15:32.305410 (+ 8305us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:32.305417 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:32.305442 (+ 25us) server_negotiation.cc:407] Connection header received
0812 11:15:32.305523 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:32.305530 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:32.305799 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:32.306049 (+ 250us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:32.306824 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.308018 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.311131 (+ 3113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.312615 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.312735 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:32.312949 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:32.313551 (+ 602us) server_negotiation.cc:299] Negotiation successful
0812 11:15:32.313735 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8147,"thread_start_us":7951,"threads_started":1}
I20260812 11:15:32.314613 5235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:32.290614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56034 (local address 127.4.26.67:39185)
0812 11:15:32.304198 (+ 13584us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:32.304209 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:32.304257 (+ 48us) server_negotiation.cc:407] Connection header received
0812 11:15:32.304391 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:32.304401 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:32.304781 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:32.306356 (+ 1575us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:32.306693 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.308301 (+ 1608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.310610 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.311975 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.313802 (+ 1827us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:32.314026 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:32.314086 (+ 60us) server_negotiation.cc:299] Negotiation successful
0812 11:15:32.314268 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13358,"thread_start_us":12963,"threads_started":1}
I20260812 11:15:32.314761 5239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:32.301051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:33227 (local address 127.0.0.1:36718)
0812 11:15:32.304631 (+ 3580us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:32.304657 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:32.304826 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:32.306215 (+ 1389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:32.306221 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:32.306244 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:32.306661 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:32.306671 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.308199 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.308204 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:32.310939 (+ 2735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:32.310955 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.313109 (+ 2154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.313115 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:32.313333 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:32.313370 (+ 37us) client_negotiation.cc:769] Sending connection context
0812 11:15:32.313467 (+ 97us) client_negotiation.cc:240] Negotiation successful
0812 11:15:32.313613 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3426,"mutex_wait_us":51,"thread_start_us":3209,"threads_started":1}
I20260812 11:15:32.315420 5233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:32.290571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:39451 (local address 127.0.0.1:56604)
0812 11:15:32.303250 (+ 12679us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:32.303277 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:32.303454 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:32.307107 (+ 3653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:32.307112 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:32.307142 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:32.307507 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:32.307519 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.309445 (+ 1926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.309450 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:32.311475 (+ 2025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:32.311487 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.314564 (+ 3077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.314570 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:32.314767 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:32.314801 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:15:32.314904 (+ 103us) client_negotiation.cc:240] Negotiation successful
0812 11:15:32.315077 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12510,"mutex_wait_us":7,"thread_start_us":14432,"threads_started":1}
I20260812 11:15:32.317436 5236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:32.291294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56604 (local address 127.4.26.65:39451)
0812 11:15:32.306226 (+ 14932us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:32.306235 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:32.306264 (+ 29us) server_negotiation.cc:407] Connection header received
0812 11:15:32.306372 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:32.306379 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:32.306642 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:32.306861 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:32.307707 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.309254 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.311640 (+ 2386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.313025 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.313172 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:32.313387 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:32.315722 (+ 2335us) server_negotiation.cc:299] Negotiation successful
0812 11:15:32.317060 (+ 1338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14755,"thread_start_us":14556,"threads_started":1}
I20260812 11:15:32.318958 5101 tablet_service.cc:1467] Processing CreateTablet for tablet 6cf366ad6b6b430892c59a1dc7082e5c (DEFAULT_TABLE table=test-table [id=7be416db8d614a9f8ba1cd62ed95f715]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:32.318975 4873 tablet_service.cc:1467] Processing CreateTablet for tablet 6cf366ad6b6b430892c59a1dc7082e5c (DEFAULT_TABLE table=test-table [id=7be416db8d614a9f8ba1cd62ed95f715]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:32.320364 5101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cf366ad6b6b430892c59a1dc7082e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:32.320454 4873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cf366ad6b6b430892c59a1dc7082e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:32.321784 4640 tablet_service.cc:1467] Processing CreateTablet for tablet 6cf366ad6b6b430892c59a1dc7082e5c (DEFAULT_TABLE table=test-table [id=7be416db8d614a9f8ba1cd62ed95f715]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:32.324390 4640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cf366ad6b6b430892c59a1dc7082e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:32.332867 5242 tablet_bootstrap.cc:492] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d: Bootstrap starting.
I20260812 11:15:32.336536 5242 tablet_bootstrap.cc:654] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:32.337808 5243 tablet_bootstrap.cc:492] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3: Bootstrap starting.
I20260812 11:15:32.338349 5242 log.cc:824] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:32.342113 5242 tablet_bootstrap.cc:492] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d: No bootstrap required, opened a new log
I20260812 11:15:32.342165 5245 tablet_bootstrap.cc:492] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965: Bootstrap starting.
I20260812 11:15:32.342195 5243 tablet_bootstrap.cc:654] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:32.343014 5242 ts_tablet_manager.cc:1397] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260812 11:15:32.343549 5243 log.cc:824] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:32.345836 5245 tablet_bootstrap.cc:654] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:32.347069 5243 tablet_bootstrap.cc:492] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3: No bootstrap required, opened a new log
I20260812 11:15:32.347355 5245 log.cc:824] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:32.347440 5243 ts_tablet_manager.cc:1397] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20260812 11:15:32.350803 5245 tablet_bootstrap.cc:492] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965: No bootstrap required, opened a new log
I20260812 11:15:32.351100 5245 ts_tablet_manager.cc:1397] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260812 11:15:32.353906 5242 raft_consensus.cc:348] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac79282114c94de889b95e6a685f338d" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 39185 } } peers { permanent_uuid: "61a8a8b3a46e44a8a46a03c89d659965" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39451 } } peers { permanent_uuid: "bd9bd2c677694471a526fc0ef33a06b3" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 33227 } }
I20260812 11:15:32.354447 5242 raft_consensus.cc:374] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:32.354607 5242 raft_consensus.cc:729] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac79282114c94de889b95e6a685f338d, State: Initialized, Role: FOLLOWER
I20260812 11:15:32.355333 5242 consensus_queue.cc:260] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac79282114c94de889b95e6a685f338d" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 39185 } } peers { permanent_uuid: "61a8a8b3a46e44a8a46a03c89d659965" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39451 } } peers { permanent_uuid: "bd9bd2c677694471a526fc0ef33a06b3" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 33227 } }
I20260812 11:15:32.356597 5207 heartbeater.cc:503] Master 127.4.26.126:34703 was elected leader, sending a full tablet report...
I20260812 11:15:32.357411 5242 ts_tablet_manager.cc:1428] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260812 11:15:32.358430 5243 raft_consensus.cc:348] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac79282114c94de889b95e6a685f338d" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 39185 } } peers { permanent_uuid: "61a8a8b3a46e44a8a46a03c89d659965" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39451 } } peers { permanent_uuid: "bd9bd2c677694471a526fc0ef33a06b3" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 33227 } }
I20260812 11:15:32.359009 5243 raft_consensus.cc:374] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:32.359154 5243 raft_consensus.cc:729] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd9bd2c677694471a526fc0ef33a06b3, State: Initialized, Role: FOLLOWER
I20260812 11:15:32.359867 5243 consensus_queue.cc:260] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac79282114c94de889b95e6a685f338d" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 39185 } } peers { permanent_uuid: "61a8a8b3a46e44a8a46a03c89d659965" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39451 } } peers { permanent_uuid: "bd9bd2c677694471a526fc0ef33a06b3" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 33227 } }
I20260812 11:15:32.360196 5245 raft_consensus.cc:348] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac79282114c94de889b95e6a685f338d" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 39185 } } peers { permanent_uuid: "61a8a8b3a46e44a8a46a03c89d659965" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39451 } } peers { permanent_uuid: "bd9bd2c677694471a526fc0ef33a06b3" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 33227 } }
I20260812 11:15:32.360721 5245 raft_consensus.cc:374] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:32.360873 5245 raft_consensus.cc:729] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61a8a8b3a46e44a8a46a03c89d659965, State: Initialized, Role: FOLLOWER
I20260812 11:15:32.361050 4987 heartbeater.cc:503] Master 127.4.26.126:34703 was elected leader, sending a full tablet report...
I20260812 11:15:32.361595 5245 consensus_queue.cc:260] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac79282114c94de889b95e6a685f338d" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 39185 } } peers { permanent_uuid: "61a8a8b3a46e44a8a46a03c89d659965" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39451 } } peers { permanent_uuid: "bd9bd2c677694471a526fc0ef33a06b3" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 33227 } }
I20260812 11:15:32.362861 5243 ts_tablet_manager.cc:1428] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3: Time spent starting tablet: real 0.015s user 0.007s sys 0.006s
I20260812 11:15:32.364650 5245 ts_tablet_manager.cc:1428] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
W20260812 11:15:32.401845 4988 tablet.cc:2369] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:15:32.465416 5213 tablet.cc:2369] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:15:32.600518 4755 tablet.cc:2369] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:15:32.649260 5249 raft_consensus.cc:482] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:15:32.649606 5249 raft_consensus.cc:504] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac79282114c94de889b95e6a685f338d" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 39185 } } peers { permanent_uuid: "61a8a8b3a46e44a8a46a03c89d659965" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39451 } } peers { permanent_uuid: "bd9bd2c677694471a526fc0ef33a06b3" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 33227 } }
I20260812 11:15:32.651788 5249 leader_election.cc:288] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac79282114c94de889b95e6a685f338d (127.4.26.67:39185), 61a8a8b3a46e44a8a46a03c89d659965 (127.4.26.65:39451)
I20260812 11:15:32.660179 5235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:32.652370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:45441 (local address 127.4.26.67:39185)
0812 11:15:32.652557 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:32.652564 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:32.653299 (+ 735us) server_negotiation.cc:407] Connection header received
0812 11:15:32.653635 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:32.653641 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:32.653725 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:32.653809 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:32.654665 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.655807 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.658220 (+ 2413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.659076 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.659204 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:32.659311 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:32.659680 (+ 369us) server_negotiation.cc:299] Negotiation successful
0812 11:15:32.659828 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:15:32.660298 5236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:32.652797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:45515 (local address 127.4.26.65:39451)
0812 11:15:32.652997 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:32.653003 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:32.653634 (+ 631us) server_negotiation.cc:407] Connection header received
0812 11:15:32.653799 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:32.653804 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:32.653874 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:32.653953 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:32.654758 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.655498 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.658144 (+ 2646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.659368 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.659500 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:32.659599 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:32.659924 (+ 325us) server_negotiation.cc:299] Negotiation successful
0812 11:15:32.660061 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 11:15:32.660431 5251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:32.652160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:39451 (local address 127.4.26.66:45515)
0812 11:15:32.653521 (+ 1361us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:32.653538 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:32.653674 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:32.653980 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:32.653983 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:32.654002 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:32.654598 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:32.654610 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.655634 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.655640 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:32.657964 (+ 2324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:32.657980 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.659603 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.659609 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:32.659779 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:32.659810 (+ 31us) client_negotiation.cc:769] Sending connection context
0812 11:15:32.659893 (+ 83us) client_negotiation.cc:240] Negotiation successful
0812 11:15:32.660022 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1244,"mutex_wait_us":38,"thread_start_us":654,"threads_started":1}
I20260812 11:15:32.660871 5253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:32.652051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:39185 (local address 127.4.26.66:45441)
0812 11:15:32.653182 (+ 1131us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:32.653206 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:32.653425 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:32.653954 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:32.653960 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:32.653985 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:32.654497 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:32.654511 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.655948 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.655954 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:32.658028 (+ 2074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:32.658039 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.659293 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.659300 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:32.659466 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:32.659500 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:15:32.660371 (+ 871us) client_negotiation.cc:240] Negotiation successful
0812 11:15:32.660507 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":959,"mutex_wait_us":23,"thread_start_us":1178,"threads_started":1}
I20260812 11:15:32.661689 4672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cf366ad6b6b430892c59a1dc7082e5c" candidate_uuid: "bd9bd2c677694471a526fc0ef33a06b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61a8a8b3a46e44a8a46a03c89d659965" is_pre_election: true
I20260812 11:15:32.661868 5135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cf366ad6b6b430892c59a1dc7082e5c" candidate_uuid: "bd9bd2c677694471a526fc0ef33a06b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac79282114c94de889b95e6a685f338d" is_pre_election: true
I20260812 11:15:32.662196 4672 raft_consensus.cc:2454] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9bd2c677694471a526fc0ef33a06b3 in term 0.
I20260812 11:15:32.662340 5135 raft_consensus.cc:2454] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd9bd2c677694471a526fc0ef33a06b3 in term 0.
I20260812 11:15:32.662859 4791 leader_election.cc:302] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61a8a8b3a46e44a8a46a03c89d659965, bd9bd2c677694471a526fc0ef33a06b3; no voters:
I20260812 11:15:32.663298 5249 raft_consensus.cc:2781] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:15:32.663452 5249 raft_consensus.cc:482] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:15:32.663570 5249 raft_consensus.cc:3037] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:32.665874 5249 raft_consensus.cc:504] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac79282114c94de889b95e6a685f338d" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 39185 } } peers { permanent_uuid: "61a8a8b3a46e44a8a46a03c89d659965" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39451 } } peers { permanent_uuid: "bd9bd2c677694471a526fc0ef33a06b3" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 33227 } }
I20260812 11:15:32.666431 5249 leader_election.cc:288] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [CANDIDATE]: Term 1 election: Requested vote from peers ac79282114c94de889b95e6a685f338d (127.4.26.67:39185), 61a8a8b3a46e44a8a46a03c89d659965 (127.4.26.65:39451)
I20260812 11:15:32.666955 4672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cf366ad6b6b430892c59a1dc7082e5c" candidate_uuid: "bd9bd2c677694471a526fc0ef33a06b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61a8a8b3a46e44a8a46a03c89d659965"
I20260812 11:15:32.666965 5135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cf366ad6b6b430892c59a1dc7082e5c" candidate_uuid: "bd9bd2c677694471a526fc0ef33a06b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac79282114c94de889b95e6a685f338d"
I20260812 11:15:32.667150 4672 raft_consensus.cc:3037] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:32.667155 5135 raft_consensus.cc:3037] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:32.669358 4672 raft_consensus.cc:2454] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9bd2c677694471a526fc0ef33a06b3 in term 1.
I20260812 11:15:32.669458 5135 raft_consensus.cc:2454] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd9bd2c677694471a526fc0ef33a06b3 in term 1.
I20260812 11:15:32.669788 4791 leader_election.cc:302] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61a8a8b3a46e44a8a46a03c89d659965, bd9bd2c677694471a526fc0ef33a06b3; no voters:
I20260812 11:15:32.670053 5249 raft_consensus.cc:2781] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:32.670526 5249 raft_consensus.cc:686] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [term 1 LEADER]: Becoming Leader. State: Replica: bd9bd2c677694471a526fc0ef33a06b3, State: Running, Role: LEADER
I20260812 11:15:32.670989 5249 consensus_queue.cc:237] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac79282114c94de889b95e6a685f338d" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 39185 } } peers { permanent_uuid: "61a8a8b3a46e44a8a46a03c89d659965" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39451 } } peers { permanent_uuid: "bd9bd2c677694471a526fc0ef33a06b3" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 33227 } }
I20260812 11:15:32.675762 4439 catalog_manager.cc:5495] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd9bd2c677694471a526fc0ef33a06b3 (127.4.26.66). New cstate: current_term: 1 leader_uuid: "bd9bd2c677694471a526fc0ef33a06b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac79282114c94de889b95e6a685f338d" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 39185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61a8a8b3a46e44a8a46a03c89d659965" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd9bd2c677694471a526fc0ef33a06b3" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 33227 } health_report { overall_health: HEALTHY } } }
I20260812 11:15:32.779601 5237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:32.772762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36720 (local address 127.4.26.66:33227)
0812 11:15:32.772946 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:32.772951 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:32.773489 (+ 538us) server_negotiation.cc:407] Connection header received
0812 11:15:32.773689 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:32.773694 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:32.773802 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:32.773948 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:15:32.774387 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.775169 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.776823 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.777357 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.777516 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:32.778139 (+ 623us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:15:32.778834 (+ 695us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:15:32.778993 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:32.779256 (+ 263us) server_negotiation.cc:299] Negotiation successful
0812 11:15:32.779356 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:15:32.789064 4672 raft_consensus.cc:1261] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965 [term 1 FOLLOWER]: Refusing update from remote peer bd9bd2c677694471a526fc0ef33a06b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:15:32.789062 5135 raft_consensus.cc:1261] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d [term 1 FOLLOWER]: Refusing update from remote peer bd9bd2c677694471a526fc0ef33a06b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:15:32.790126 5254 consensus_queue.cc:1035] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac79282114c94de889b95e6a685f338d" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 39185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:15:32.790514 5249 consensus_queue.cc:1035] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61a8a8b3a46e44a8a46a03c89d659965" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:15:32.803463 5262 mvcc.cc:205] Tried to move back new op lower bound from 7317640531092840448 to 7317640530623975424. Current Snapshot: MvccSnapshot[applied={T|T < 7317640531092840448}]
I20260812 11:15:32.803922 5264 mvcc.cc:205] Tried to move back new op lower bound from 7317640531092840448 to 7317640530623975424. Current Snapshot: MvccSnapshot[applied={T|T < 7317640531092840448}]
I20260812 11:15:32.819669 4439 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:15:32.819996 4439 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:15:32.824211 4439 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4d7e6966ed9e4cfcbfca3dab3f11d99d: Sending DeleteTablet for 3 replicas of tablet 6cf366ad6b6b430892c59a1dc7082e5c
I20260812 11:15:32.825992 4873 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cf366ad6b6b430892c59a1dc7082e5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:32 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:36718
I20260812 11:15:32.826064 4640 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cf366ad6b6b430892c59a1dc7082e5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:32 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:56604
I20260812 11:15:32.825770 5101 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cf366ad6b6b430892c59a1dc7082e5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:32 UTC) from {username='kudu', principal='kudu/127.4.26.126@KRBTEST.COM'} at 127.0.0.1:56034
I20260812 11:15:32.827998 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 4543
I20260812 11:15:32.833726 5277 tablet_replica.cc:330] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d: stopping tablet replica
I20260812 11:15:32.834359 5277 raft_consensus.cc:2229] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:15:32.835090 5277 raft_consensus.cc:2258] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:15:32.838798 5274 tablet_replica.cc:330] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3: stopping tablet replica
I20260812 11:15:32.839504 5274 raft_consensus.cc:2229] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:15:32.839589 5277 ts_tablet_manager.cc:1905] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:15:32.840487 5274 raft_consensus.cc:2258] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:15:32.843317 5274 ts_tablet_manager.cc:1905] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:15:32.852448 5275 tablet_replica.cc:330] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965: stopping tablet replica
I20260812 11:15:32.853122 5275 raft_consensus.cc:2229] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:15:32.853823 5275 raft_consensus.cc:2258] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:15:32.856333 5275 ts_tablet_manager.cc:1905] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 12 11:15:32 dist-test-slave-rmhg krb5kdc[4363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.65@KRBTEST.COM
I20260812 11:15:32.857782 5277 ts_tablet_manager.cc:1918] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:32.857775 5274 ts_tablet_manager.cc:1918] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:32.858036 5277 log.cc:1196] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/6cf366ad6b6b430892c59a1dc7082e5c
I20260812 11:15:32.858093 5274 log.cc:1196] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/6cf366ad6b6b430892c59a1dc7082e5c
I20260812 11:15:32.858701 5277 ts_tablet_manager.cc:1939] T 6cf366ad6b6b430892c59a1dc7082e5c P ac79282114c94de889b95e6a685f338d: Deleting consensus metadata
I20260812 11:15:32.858763 5274 ts_tablet_manager.cc:1939] T 6cf366ad6b6b430892c59a1dc7082e5c P bd9bd2c677694471a526fc0ef33a06b3: Deleting consensus metadata
I20260812 11:15:32.860822 4417 catalog_manager.cc:4841] TS bd9bd2c677694471a526fc0ef33a06b3 (127.4.26.66:33227): tablet 6cf366ad6b6b430892c59a1dc7082e5c (table test-table [id=7be416db8d614a9f8ba1cd62ed95f715]) successfully deleted
I20260812 11:15:32.861224 4417 catalog_manager.cc:4841] TS ac79282114c94de889b95e6a685f338d (127.4.26.67:39185): tablet 6cf366ad6b6b430892c59a1dc7082e5c (table test-table [id=7be416db8d614a9f8ba1cd62ed95f715]) successfully deleted
I20260812 11:15:32.864185 5275 ts_tablet_manager.cc:1918] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:32.864464 5275 log.cc:1196] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/6cf366ad6b6b430892c59a1dc7082e5c
I20260812 11:15:32.865075 5275 ts_tablet_manager.cc:1939] T 6cf366ad6b6b430892c59a1dc7082e5c P 61a8a8b3a46e44a8a46a03c89d659965: Deleting consensus metadata
I20260812 11:15:32.867226 4413 catalog_manager.cc:4841] TS 61a8a8b3a46e44a8a46a03c89d659965 (127.4.26.65:39451): tablet 6cf366ad6b6b430892c59a1dc7082e5c (table test-table [id=7be416db8d614a9f8ba1cd62ed95f715]) successfully deleted
I20260812 11:15:32.869241 5236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:32.829557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56614 (local address 127.4.26.65:39451)
0812 11:15:32.829749 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:32.829755 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:32.840907 (+ 11152us) server_negotiation.cc:407] Connection header received
0812 11:15:32.841473 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:32.841479 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:32.841608 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:32.841691 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:32.843644 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.844919 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.846943 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:32.847663 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:32.847772 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:32.862238 (+ 14466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:32.862253 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:32.862270 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:32.862320 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:32.865872 (+ 3552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:32.866732 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:32.866740 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:32.866742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:32.866899 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:32.867394 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:32.867400 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:32.867403 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:32.867868 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:32.868198 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:32.868541 (+ 343us) server_negotiation.cc:299] Negotiation successful
0812 11:15:32.868777 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:15:32.869879 4744 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:32.960853 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 4543
I20260812 11:15:32.997400 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 4762
Aug 12 11:15:33 dist-test-slave-rmhg krb5kdc[4363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.66@KRBTEST.COM
I20260812 11:15:33.015712 5237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:32.998353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36734 (local address 127.4.26.66:33227)
0812 11:15:32.998512 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:32.998516 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:32.998535 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:15:32.998778 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:32.998782 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:32.998867 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:32.998969 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:33.000659 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:33.001558 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:33.003444 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:33.003921 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:33.004035 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:33.009280 (+ 5245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:33.009296 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:33.009316 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:33.009361 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:33.012526 (+ 3165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:33.013446 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:33.013454 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:33.013457 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:33.013650 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:33.014065 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:33.014070 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:33.014072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:33.014482 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:33.014837 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:33.015105 (+ 268us) server_negotiation.cc:299] Negotiation successful
0812 11:15:33.015345 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:15:33.016428 4979 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:33.133260 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 4762
I20260812 11:15:33.160537 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 4997
Aug 12 11:15:33 dist-test-slave-rmhg krb5kdc[4363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.67@KRBTEST.COM
I20260812 11:15:33.177837 5283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:33.161409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56044 (local address 127.4.26.67:39185)
0812 11:15:33.161883 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:33.161888 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:33.161906 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:15:33.161962 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:33.161965 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:33.162035 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:33.162133 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:33.163636 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:33.164422 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:33.165891 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:33.166309 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:33.166408 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:33.171080 (+ 4672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:33.171100 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:33.171119 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:33.171165 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:33.174107 (+ 2942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:33.175100 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:33.175111 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:33.175113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:33.175311 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:33.175845 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:33.175851 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:33.175853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:33.176310 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:33.176631 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:33.177095 (+ 464us) server_negotiation.cc:299] Negotiation successful
0812 11:15:33.177391 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":266,"threads_started":1}
I20260812 11:15:33.178761 5202 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:33.269239 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 4997
I20260812 11:15:33.294241 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 4383
I20260812 11:15:33.295497 4492 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:33.410442 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 4383
2026-08-12T11:15:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (5694 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-12T11:15:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:15:33Z Disabled control of system clock
I20260812 11:15:33.511062 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:42775
--webserver_interface=127.4.26.126
--webserver_port=0
--builtin_ntp_servers=127.4.26.84:41627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:42775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:15:33.874172 5291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:33.874485 5291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:33.874577 5291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:33.881974 5291 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:15:33.882100 5291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:33.882161 5291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:33.882246 5291 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:15:33.882301 5291 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:15:33.891805 5291 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:41627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:42775
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:42775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:33.893225 5291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:33.895139 5291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:33.907032 5298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:33.907071 5299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:33.907073 5303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:33.907855 5291 server_base.cc:1034] running on GCE node
I20260812 11:15:33.908747 5291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:33.910308 5291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:33.911533 5291 hybrid_clock.cc:648] HybridClock initialized: now 1786533333911480 us; error 52 us; skew 500 ppm
I20260812 11:15:33.911906 5291 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:15:33.914357 5291 webserver.cc:460] Webserver started at http://127.4.26.126:35417/ using document root <none> and password file <none>
I20260812 11:15:33.915062 5291 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:33.915169 5291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:33.915475 5291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:33.918501 5291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "08dff408f8f14df7a98f4a13529c6339"
format_stamp: "Formatted at 2026-08-12 11:15:33 on dist-test-slave-rmhg"
server_key: "2bdeac4830f13cbf8c3d38d6e63c825b"
server_key_iv: "bb46cd71abd2ffe63802bf29790f0c77"
server_key_version: "encryptionkey@0"
I20260812 11:15:33.919337 5291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "08dff408f8f14df7a98f4a13529c6339"
format_stamp: "Formatted at 2026-08-12 11:15:33 on dist-test-slave-rmhg"
server_key: "2bdeac4830f13cbf8c3d38d6e63c825b"
server_key_iv: "bb46cd71abd2ffe63802bf29790f0c77"
server_key_version: "encryptionkey@0"
I20260812 11:15:33.924685 5291 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:15:33.928278 5314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:33.929793 5291 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:15:33.929972 5291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "08dff408f8f14df7a98f4a13529c6339"
format_stamp: "Formatted at 2026-08-12 11:15:33 on dist-test-slave-rmhg"
server_key: "2bdeac4830f13cbf8c3d38d6e63c825b"
server_key_iv: "bb46cd71abd2ffe63802bf29790f0c77"
server_key_version: "encryptionkey@0"
I20260812 11:15:33.930181 5291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:34.007503 5291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:34.008450 5291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:34.008749 5291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:34.026999 5291 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:42775
I20260812 11:15:34.027019 5396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:42775 every 8 connection(s)
I20260812 11:15:34.028410 5291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:15:34.032347 5398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:34.035635 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 5291
I20260812 11:15:34.035820 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:15:34.036360 4201 external_mini_cluster.cc:1428] Setting key 01f486621adb1695a61712fccc16a871
I20260812 11:15:34.045456 5398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339: Bootstrap starting.
I20260812 11:15:34.049132 5398 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:34.050410 5398 log.cc:824] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:34.051505 5405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:34.038664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50304 (local address 127.4.26.126:42775)
0812 11:15:34.039802 (+ 1138us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:34.039815 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:34.039863 (+ 48us) server_negotiation.cc:407] Connection header received
0812 11:15:34.041728 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:34.041758 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:34.042346 (+ 588us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:34.042804 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:34.043491 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:34.044836 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:34.046386 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:34.047194 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:34.047406 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:34.048727 (+ 1321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:34.048736 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:34.048753 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:34.049426 (+ 673us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:34.049527 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:34.049555 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:34.049692 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:34.049927 (+ 235us) server_negotiation.cc:299] Negotiation successful
0812 11:15:34.050279 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":661,"thread_start_us":395,"threads_started":1}
I20260812 11:15:34.053580 5398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339: No bootstrap required, opened a new log
I20260812 11:15:34.061640 5398 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08dff408f8f14df7a98f4a13529c6339" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42775 } }
I20260812 11:15:34.062057 5398 raft_consensus.cc:374] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:34.062178 5398 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08dff408f8f14df7a98f4a13529c6339, State: Initialized, Role: FOLLOWER
I20260812 11:15:34.062821 5398 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08dff408f8f14df7a98f4a13529c6339" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42775 } }
I20260812 11:15:34.063061 5398 raft_consensus.cc:388] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:15:34.063208 5398 raft_consensus.cc:482] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:15:34.063371 5398 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:34.065899 5398 raft_consensus.cc:504] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08dff408f8f14df7a98f4a13529c6339" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42775 } }
I20260812 11:15:34.066473 5398 leader_election.cc:302] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 08dff408f8f14df7a98f4a13529c6339; no voters:
I20260812 11:15:34.067051 5398 leader_election.cc:288] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:15:34.067205 5408 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:34.068177 5408 raft_consensus.cc:686] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [term 1 LEADER]: Becoming Leader. State: Replica: 08dff408f8f14df7a98f4a13529c6339, State: Running, Role: LEADER
I20260812 11:15:34.068688 5408 consensus_queue.cc:237] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08dff408f8f14df7a98f4a13529c6339" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42775 } }
I20260812 11:15:34.069077 5398 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:15:34.071642 5411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "08dff408f8f14df7a98f4a13529c6339" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08dff408f8f14df7a98f4a13529c6339" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42775 } } }
I20260812 11:15:34.071586 5413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08dff408f8f14df7a98f4a13529c6339. Latest consensus state: current_term: 1 leader_uuid: "08dff408f8f14df7a98f4a13529c6339" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08dff408f8f14df7a98f4a13529c6339" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42775 } } }
I20260812 11:15:34.072075 5411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:34.072081 5413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:34.074478 5423 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:15:34.079169 5423 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:15:34.088625 5423 catalog_manager.cc:1347] Generated new cluster ID: 37736ee3418941338ee14ab5b9146e31
I20260812 11:15:34.088820 5423 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:15:34.107057 5423 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:15:34.109053 5423 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:15:34.125116 5423 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339: Generated new TSK 0
I20260812 11:15:34.126066 5423 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:15:34.131326 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.65:0
--local_ip_for_outbound_sockets=127.4.26.65
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:42775
--builtin_ntp_servers=127.4.26.84:41627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260812 11:15:34.506351 5436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:34.506621 5436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:34.506754 5436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:34.514026 5436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:34.514139 5436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:34.514276 5436 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.65
I20260812 11:15:34.523514 5436 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:41627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.26.65
--webserver_port=0
--tserver_master_addrs=127.4.26.126:42775
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.65
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:34.524873 5436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:34.526659 5436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:34.540421 5444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:34.540249 5447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:34.540288 5445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:34.541203 5436 server_base.cc:1034] running on GCE node
I20260812 11:15:34.541887 5436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:34.542891 5436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:34.544107 5436 hybrid_clock.cc:648] HybridClock initialized: now 1786533334544059 us; error 56 us; skew 500 ppm
I20260812 11:15:34.544484 5436 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:15:34.546867 5436 webserver.cc:460] Webserver started at http://127.4.26.65:42747/ using document root <none> and password file <none>
I20260812 11:15:34.547571 5436 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:34.547686 5436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:34.548002 5436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:34.550983 5436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/data/instance:
uuid: "9fc29a0df6344635b1affcbdbce18a1e"
format_stamp: "Formatted at 2026-08-12 11:15:34 on dist-test-slave-rmhg"
server_key: "7db0ee6a68f7d0449116e863ce85a50c"
server_key_iv: "fc4e0884d1cfe55fcc42b2c4d77bcabd"
server_key_version: "encryptionkey@0"
I20260812 11:15:34.551779 5436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance:
uuid: "9fc29a0df6344635b1affcbdbce18a1e"
format_stamp: "Formatted at 2026-08-12 11:15:34 on dist-test-slave-rmhg"
server_key: "7db0ee6a68f7d0449116e863ce85a50c"
server_key_iv: "fc4e0884d1cfe55fcc42b2c4d77bcabd"
server_key_version: "encryptionkey@0"
I20260812 11:15:34.557001 5436 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:15:34.560662 5457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:34.562086 5436 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:15:34.562254 5436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/wal
uuid: "9fc29a0df6344635b1affcbdbce18a1e"
format_stamp: "Formatted at 2026-08-12 11:15:34 on dist-test-slave-rmhg"
server_key: "7db0ee6a68f7d0449116e863ce85a50c"
server_key_iv: "fc4e0884d1cfe55fcc42b2c4d77bcabd"
server_key_version: "encryptionkey@0"
I20260812 11:15:34.562487 5436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:34.584048 5436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:34.584978 5436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:34.585309 5436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:34.586325 5436 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:34.587944 5436 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:34.588044 5436 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:34.588157 5436 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:34.588227 5436 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:34.619230 5436 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.65:39235
I20260812 11:15:34.619292 5643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.65:39235 every 8 connection(s)
I20260812 11:15:34.620627 5436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/data/info.pb
I20260812 11:15:34.630336 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 5436
I20260812 11:15:34.630550 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/wal/instance
I20260812 11:15:34.631142 4201 external_mini_cluster.cc:1428] Setting key 579ac44042ddfa6ebb3cc249e4af8f26
I20260812 11:15:34.633908 5650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:34.623349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.65:41809 (local address 127.4.26.126:42775)
0812 11:15:34.623795 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:34.623800 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:34.625112 (+ 1312us) server_negotiation.cc:407] Connection header received
0812 11:15:34.626984 (+ 1872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:34.626989 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:34.627068 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:34.627165 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:34.628235 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:34.628958 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:34.630671 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:34.631307 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:34.631453 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:34.632902 (+ 1449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:34.632907 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:34.632910 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:34.632929 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:34.632970 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:34.633012 (+ 42us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:34.633105 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:34.633434 (+ 329us) server_negotiation.cc:299] Negotiation successful
0812 11:15:34.633540 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":231,"threads_started":1}
I20260812 11:15:34.634516 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.66:0
--local_ip_for_outbound_sockets=127.4.26.66
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:42775
--builtin_ntp_servers=127.4.26.84:41627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:15:34.634970 5651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:34.623927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:42775 (local address 127.4.26.65:41809)
0812 11:15:34.624948 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:34.624989 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:34.626717 (+ 1728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:34.627401 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:34.627409 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:34.627495 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:34.628060 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:34.628077 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:34.629174 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:34.629180 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:34.630478 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:34.630494 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:34.631518 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:34.631523 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:34.631750 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:34.632519 (+ 769us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:15:34.632522 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:34.632580 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:15:34.632697 (+ 117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:34.633180 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:34.633193 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:34.633202 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 11:15:34.633392 (+ 190us) client_negotiation.cc:240] Negotiation successful
0812 11:15:34.633745 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":283,"threads_started":1}
I20260812 11:15:34.636484 5644 heartbeater.cc:347] Connected to a master server at 127.4.26.126:42775
I20260812 11:15:34.636821 5644 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:34.637741 5644 heartbeater.cc:511] Master 127.4.26.126:42775 requested a full tablet report, sending...
I20260812 11:15:34.640038 5343 ts_manager.cc:194] Registered new tserver with Master: 9fc29a0df6344635b1affcbdbce18a1e (127.4.26.65:39235)
I20260812 11:15:34.641920 5343 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.26.65:41809
W20260812 11:15:34.980121 5654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:34.980420 5654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:34.980530 5654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:34.988202 5654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:34.988320 5654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:34.988467 5654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.66
I20260812 11:15:34.997934 5654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:41627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.26.66
--webserver_port=0
--tserver_master_addrs=127.4.26.126:42775
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.66
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:34.999285 5654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:35.001127 5654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:35.014217 5664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:35.014271 5661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:35.014480 5662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:35.015012 5654 server_base.cc:1034] running on GCE node
I20260812 11:15:35.015612 5654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:35.016508 5654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:35.017711 5654 hybrid_clock.cc:648] HybridClock initialized: now 1786533335017655 us; error 52 us; skew 500 ppm
I20260812 11:15:35.018028 5654 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:15:35.020309 5654 webserver.cc:460] Webserver started at http://127.4.26.66:45373/ using document root <none> and password file <none>
I20260812 11:15:35.021015 5654 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:35.021130 5654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:35.021486 5654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:35.024470 5654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/data/instance:
uuid: "dbebe6620bf9464eac3c7e7f6797df53"
format_stamp: "Formatted at 2026-08-12 11:15:35 on dist-test-slave-rmhg"
server_key: "44d8b8572011e85b5732c5e7ade10cd6"
server_key_iv: "3b9dc5db18345e727485d93fc2912a7a"
server_key_version: "encryptionkey@0"
I20260812 11:15:35.025342 5654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance:
uuid: "dbebe6620bf9464eac3c7e7f6797df53"
format_stamp: "Formatted at 2026-08-12 11:15:35 on dist-test-slave-rmhg"
server_key: "44d8b8572011e85b5732c5e7ade10cd6"
server_key_iv: "3b9dc5db18345e727485d93fc2912a7a"
server_key_version: "encryptionkey@0"
I20260812 11:15:35.030680 5654 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260812 11:15:35.034660 5675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:35.036154 5654 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:15:35.036315 5654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/wal
uuid: "dbebe6620bf9464eac3c7e7f6797df53"
format_stamp: "Formatted at 2026-08-12 11:15:35 on dist-test-slave-rmhg"
server_key: "44d8b8572011e85b5732c5e7ade10cd6"
server_key_iv: "3b9dc5db18345e727485d93fc2912a7a"
server_key_version: "encryptionkey@0"
I20260812 11:15:35.036528 5654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:35.063844 5654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:35.064775 5654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:35.065068 5654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:35.066255 5654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:35.067998 5654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:35.068113 5654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:35.068228 5654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:35.068300 5654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:35.099905 5654 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.66:43053
I20260812 11:15:35.099962 5874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.66:43053 every 8 connection(s)
I20260812 11:15:35.101301 5654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/data/info.pb
I20260812 11:15:35.109289 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 5654
I20260812 11:15:35.109478 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/wal/instance
I20260812 11:15:35.109905 4201 external_mini_cluster.cc:1428] Setting key 6ef2927d0a3bc2717d18efcd87cb26fc
I20260812 11:15:35.113029 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.26.67:0
--local_ip_for_outbound_sockets=127.4.26.67
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:42775
--builtin_ntp_servers=127.4.26.84:41627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260812 11:15:35.114111 5650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.103732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.66:36391 (local address 127.4.26.126:42775)
0812 11:15:35.103903 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:35.103907 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:35.105430 (+ 1523us) server_negotiation.cc:407] Connection header received
0812 11:15:35.107140 (+ 1710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:35.107145 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:35.107214 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:35.107300 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:35.108357 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.109393 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.111165 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.111638 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.111769 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.113392 (+ 1623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:35.113397 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:35.113401 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:35.113421 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:35.113453 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:35.113464 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:35.113534 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:35.113780 (+ 246us) server_negotiation.cc:299] Negotiation successful
0812 11:15:35.113863 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:15:35.115514 5881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.104291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:42775 (local address 127.4.26.66:36391)
0812 11:15:35.105264 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:35.105310 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:35.106911 (+ 1601us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:35.107477 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:35.107486 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:35.107577 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:35.108175 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:35.108191 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.109572 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.109577 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:35.111015 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:35.111028 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.111860 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.111868 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:35.112187 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.112916 (+ 729us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:15:35.112919 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:35.112986 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:15:35.113114 (+ 128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:35.113555 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:35.113566 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:35.113575 (+ 9us) client_negotiation.cc:769] Sending connection context
0812 11:15:35.113762 (+ 187us) client_negotiation.cc:240] Negotiation successful
0812 11:15:35.114198 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":306,"threads_started":1}
I20260812 11:15:35.116941 5875 heartbeater.cc:347] Connected to a master server at 127.4.26.126:42775
I20260812 11:15:35.117292 5875 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:35.118167 5875 heartbeater.cc:511] Master 127.4.26.126:42775 requested a full tablet report, sending...
I20260812 11:15:35.119717 5343 ts_manager.cc:194] Registered new tserver with Master: dbebe6620bf9464eac3c7e7f6797df53 (127.4.26.66:43053)
I20260812 11:15:35.120711 5343 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.26.66:36391
W20260812 11:15:35.465021 5882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:35.465401 5882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:35.465538 5882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:35.473182 5882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:35.473341 5882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:35.473507 5882 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.26.67
I20260812 11:15:35.483282 5882 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:41627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.26.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.26.67
--webserver_port=0
--tserver_master_addrs=127.4.26.126:42775
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.26.67
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:35.484731 5882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:35.486727 5882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:35.500782 5890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:35.500838 5894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:35.500897 5891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:35.501705 5882 server_base.cc:1034] running on GCE node
I20260812 11:15:35.502332 5882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:35.503304 5882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:35.504529 5882 hybrid_clock.cc:648] HybridClock initialized: now 1786533335504473 us; error 45 us; skew 500 ppm
I20260812 11:15:35.504866 5882 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 11:15:35.507196 5882 webserver.cc:460] Webserver started at http://127.4.26.67:33287/ using document root <none> and password file <none>
I20260812 11:15:35.507881 5882 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:35.507983 5882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:35.508319 5882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:35.511380 5882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/data/instance:
uuid: "bc4fff7e1d5d4149b580bfe138c95923"
format_stamp: "Formatted at 2026-08-12 11:15:35 on dist-test-slave-rmhg"
server_key: "189d533f8a175f0daad9c8421276116e"
server_key_iv: "482ddafbb0239c49944ba1eb411e6df7"
server_key_version: "encryptionkey@0"
I20260812 11:15:35.512199 5882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance:
uuid: "bc4fff7e1d5d4149b580bfe138c95923"
format_stamp: "Formatted at 2026-08-12 11:15:35 on dist-test-slave-rmhg"
server_key: "189d533f8a175f0daad9c8421276116e"
server_key_iv: "482ddafbb0239c49944ba1eb411e6df7"
server_key_version: "encryptionkey@0"
I20260812 11:15:35.517664 5882 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:15:35.521318 5904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:35.522859 5882 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:15:35.523029 5882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/wal
uuid: "bc4fff7e1d5d4149b580bfe138c95923"
format_stamp: "Formatted at 2026-08-12 11:15:35 on dist-test-slave-rmhg"
server_key: "189d533f8a175f0daad9c8421276116e"
server_key_iv: "482ddafbb0239c49944ba1eb411e6df7"
server_key_version: "encryptionkey@0"
I20260812 11:15:35.523262 5882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:35.552548 5882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:35.553565 5882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:35.553864 5882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:35.554888 5882 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 11:15:35.556473 5882 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 11:15:35.556572 5882 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:35.556687 5882 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 11:15:35.556758 5882 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:35.589239 5882 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.67:38091
I20260812 11:15:35.589293 6079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.67:38091 every 8 connection(s)
I20260812 11:15:35.590659 5882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/data/info.pb
I20260812 11:15:35.597460 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 5882
I20260812 11:15:35.597674 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/wal/instance
I20260812 11:15:35.598240 4201 external_mini_cluster.cc:1428] Setting key 32b77915a03d752780f3e268385c3b44
I20260812 11:15:35.604625 5650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.593370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:36393 (local address 127.4.26.126:42775)
0812 11:15:35.593583 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:35.593589 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:35.595136 (+ 1547us) server_negotiation.cc:407] Connection header received
0812 11:15:35.597006 (+ 1870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:35.597012 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:35.597094 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:35.597231 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:35.598804 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.599801 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.601811 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.602234 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.602332 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.603851 (+ 1519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:35.603856 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:35.603859 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:35.603880 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:35.603915 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:35.603927 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:35.604004 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:35.604224 (+ 220us) server_negotiation.cc:299] Negotiation successful
0812 11:15:35.604312 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:15:35.605834 6082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.593966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:42775 (local address 127.4.26.67:36393)
0812 11:15:35.594954 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:35.594994 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:35.596697 (+ 1703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:35.597528 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:35.597541 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:35.597683 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:15:35.598566 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:35.598604 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.599995 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.600002 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:35.601672 (+ 1670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:35.601686 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.602446 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.602451 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:35.602684 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.603424 (+ 740us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0812 11:15:35.603427 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:15:35.603480 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0812 11:15:35.603620 (+ 140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:15:35.604023 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:15:35.604031 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:15:35.604038 (+ 7us) client_negotiation.cc:769] Sending connection context
0812 11:15:35.604207 (+ 169us) client_negotiation.cc:240] Negotiation successful
0812 11:15:35.604614 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":288,"threads_started":1}
I20260812 11:15:35.607272 6080 heartbeater.cc:347] Connected to a master server at 127.4.26.126:42775
I20260812 11:15:35.607587 6080 heartbeater.cc:464] Registering TS with master...
I20260812 11:15:35.608326 6080 heartbeater.cc:511] Master 127.4.26.126:42775 requested a full tablet report, sending...
I20260812 11:15:35.609776 5343 ts_manager.cc:194] Registered new tserver with Master: bc4fff7e1d5d4149b580bfe138c95923 (127.4.26.67:38091)
I20260812 11:15:35.610594 5343 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.26.67:36393
I20260812 11:15:35.613791 4201 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 11:15:35.624894 5650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.618073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50312 (local address 127.4.26.126:42775)
0812 11:15:35.618261 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:35.618268 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:35.618832 (+ 564us) server_negotiation.cc:407] Connection header received
0812 11:15:35.619015 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:35.619018 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:35.619089 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:35.619172 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:35.619736 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.620416 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.622344 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.622825 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.622922 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.624085 (+ 1163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:35.624090 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:35.624094 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:35.624112 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:35.624146 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:35.624158 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:35.624228 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:35.624357 (+ 129us) server_negotiation.cc:299] Negotiation successful
0812 11:15:35.624503 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:15:35.628736 5343 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50312:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 11:15:35.635632 5343 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 11:15:35.645558 5644 heartbeater.cc:503] Master 127.4.26.126:42775 was elected leader, sending a full tablet report...
I20260812 11:15:35.662070 6100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.649095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:39235 (local address 127.0.0.1:55390)
0812 11:15:35.650728 (+ 1633us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:35.650777 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:35.650943 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:35.654931 (+ 3988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:35.654936 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:35.654971 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:35.655741 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:35.655760 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.657649 (+ 1889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.657654 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:35.659172 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:35.659189 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.661007 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.661015 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:35.661267 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.661333 (+ 66us) client_negotiation.cc:769] Sending connection context
0812 11:15:35.661428 (+ 95us) client_negotiation.cc:240] Negotiation successful
0812 11:15:35.661615 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1367,"mutex_wait_us":23,"thread_start_us":1195,"threads_started":1}
I20260812 11:15:35.662606 6106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.649771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55390 (local address 127.4.26.65:39235)
0812 11:15:35.652375 (+ 2604us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:35.652386 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:35.652424 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:15:35.652557 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:35.652566 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:35.652854 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:35.654943 (+ 2089us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:35.655954 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.657515 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.659395 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.660750 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.661655 (+ 905us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.661947 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:35.662032 (+ 85us) server_negotiation.cc:299] Negotiation successful
0812 11:15:35.662224 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2384,"thread_start_us":2542,"threads_started":1}
I20260812 11:15:35.662895 6101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.649241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:43053 (local address 127.0.0.1:59352)
0812 11:15:35.653060 (+ 3819us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:35.653081 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:35.653242 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:35.654403 (+ 1161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:35.654410 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:35.654443 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:35.654888 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:35.654904 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.656846 (+ 1942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.656851 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:35.659334 (+ 2483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:35.659349 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.662077 (+ 2728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.662084 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:35.662277 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.662311 (+ 34us) client_negotiation.cc:769] Sending connection context
0812 11:15:35.662400 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 11:15:35.662541 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3631,"mutex_wait_us":81,"thread_start_us":2194,"threads_started":1}
I20260812 11:15:35.663805 6105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.649285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59352 (local address 127.4.26.66:43053)
0812 11:15:35.653794 (+ 4509us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:35.653803 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:35.653834 (+ 31us) server_negotiation.cc:407] Connection header received
0812 11:15:35.653932 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:35.653940 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:35.654179 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:35.654365 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:35.655131 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.656686 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.659561 (+ 2875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.661525 (+ 1964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.661654 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.661912 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:35.663285 (+ 1373us) server_negotiation.cc:299] Negotiation successful
0812 11:15:35.663472 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4323,"thread_start_us":4189,"threads_started":1}
I20260812 11:15:35.664348 6108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.651865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.67:38091 (local address 127.0.0.1:42600)
0812 11:15:35.655889 (+ 4024us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:35.655908 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:35.656040 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:35.656741 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:35.656746 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:35.656771 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:35.657237 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:35.657250 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.659255 (+ 2005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.659260 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:35.661372 (+ 2112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:35.661389 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.663542 (+ 2153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.663549 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:35.663722 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.663755 (+ 33us) client_negotiation.cc:769] Sending connection context
0812 11:15:35.663841 (+ 86us) client_negotiation.cc:240] Negotiation successful
0812 11:15:35.663977 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3891,"mutex_wait_us":1038,"thread_start_us":2413,"threads_started":1}
I20260812 11:15:35.664415 6107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.652167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42600 (local address 127.4.26.67:38091)
0812 11:15:35.654222 (+ 2055us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:35.654232 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:35.656174 (+ 1942us) server_negotiation.cc:407] Connection header received
0812 11:15:35.656281 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:35.656289 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:35.656528 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:35.656709 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:35.657481 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.659095 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.661606 (+ 2511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.663349 (+ 1743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.663478 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.663765 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:35.663914 (+ 149us) server_negotiation.cc:299] Negotiation successful
0812 11:15:35.664103 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1873,"thread_start_us":1695,"threads_started":1}
I20260812 11:15:35.667263 5538 tablet_service.cc:1467] Processing CreateTablet for tablet b9c5a1e093b64627812f5ad0607ff25c (DEFAULT_TABLE table=test-table [id=5717c6f965264e4e91a693da97e43c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:35.667596 5758 tablet_service.cc:1467] Processing CreateTablet for tablet b9c5a1e093b64627812f5ad0607ff25c (DEFAULT_TABLE table=test-table [id=5717c6f965264e4e91a693da97e43c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:35.668800 5758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9c5a1e093b64627812f5ad0607ff25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:35.668895 5538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9c5a1e093b64627812f5ad0607ff25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:35.669075 5980 tablet_service.cc:1467] Processing CreateTablet for tablet b9c5a1e093b64627812f5ad0607ff25c (DEFAULT_TABLE table=test-table [id=5717c6f965264e4e91a693da97e43c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 11:15:35.670637 5980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9c5a1e093b64627812f5ad0607ff25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:35.681741 6109 tablet_bootstrap.cc:492] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53: Bootstrap starting.
I20260812 11:15:35.685037 6109 tablet_bootstrap.cc:654] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:35.685766 6111 tablet_bootstrap.cc:492] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923: Bootstrap starting.
I20260812 11:15:35.686553 6109 log.cc:824] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:35.687490 6110 tablet_bootstrap.cc:492] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e: Bootstrap starting.
I20260812 11:15:35.689935 6111 tablet_bootstrap.cc:654] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:35.691084 6111 log.cc:824] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:35.691138 6110 tablet_bootstrap.cc:654] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:35.692052 6109 tablet_bootstrap.cc:492] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53: No bootstrap required, opened a new log
I20260812 11:15:35.692364 6109 ts_tablet_manager.cc:1397] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.007s
I20260812 11:15:35.692407 6110 log.cc:824] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:35.694180 6111 tablet_bootstrap.cc:492] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923: No bootstrap required, opened a new log
I20260812 11:15:35.694543 6111 ts_tablet_manager.cc:1397] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260812 11:15:35.695637 6110 tablet_bootstrap.cc:492] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e: No bootstrap required, opened a new log
I20260812 11:15:35.695917 6110 ts_tablet_manager.cc:1397] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260812 11:15:35.702543 6111 raft_consensus.cc:348] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fc29a0df6344635b1affcbdbce18a1e" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39235 } } peers { permanent_uuid: "dbebe6620bf9464eac3c7e7f6797df53" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43053 } } peers { permanent_uuid: "bc4fff7e1d5d4149b580bfe138c95923" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38091 } }
I20260812 11:15:35.702937 6111 raft_consensus.cc:374] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:35.702694 6109 raft_consensus.cc:348] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fc29a0df6344635b1affcbdbce18a1e" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39235 } } peers { permanent_uuid: "dbebe6620bf9464eac3c7e7f6797df53" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43053 } } peers { permanent_uuid: "bc4fff7e1d5d4149b580bfe138c95923" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38091 } }
I20260812 11:15:35.703063 6111 raft_consensus.cc:729] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc4fff7e1d5d4149b580bfe138c95923, State: Initialized, Role: FOLLOWER
I20260812 11:15:35.703130 6109 raft_consensus.cc:374] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:35.703227 6109 raft_consensus.cc:729] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbebe6620bf9464eac3c7e7f6797df53, State: Initialized, Role: FOLLOWER
I20260812 11:15:35.703800 6111 consensus_queue.cc:260] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fc29a0df6344635b1affcbdbce18a1e" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39235 } } peers { permanent_uuid: "dbebe6620bf9464eac3c7e7f6797df53" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43053 } } peers { permanent_uuid: "bc4fff7e1d5d4149b580bfe138c95923" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38091 } }
I20260812 11:15:35.703830 6109 consensus_queue.cc:260] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fc29a0df6344635b1affcbdbce18a1e" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39235 } } peers { permanent_uuid: "dbebe6620bf9464eac3c7e7f6797df53" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43053 } } peers { permanent_uuid: "bc4fff7e1d5d4149b580bfe138c95923" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38091 } }
I20260812 11:15:35.704937 6080 heartbeater.cc:503] Master 127.4.26.126:42775 was elected leader, sending a full tablet report...
I20260812 11:15:35.706152 6111 ts_tablet_manager.cc:1428] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260812 11:15:35.706503 6110 raft_consensus.cc:348] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fc29a0df6344635b1affcbdbce18a1e" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39235 } } peers { permanent_uuid: "dbebe6620bf9464eac3c7e7f6797df53" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43053 } } peers { permanent_uuid: "bc4fff7e1d5d4149b580bfe138c95923" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38091 } }
I20260812 11:15:35.707036 6110 raft_consensus.cc:374] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:35.707161 5875 heartbeater.cc:503] Master 127.4.26.126:42775 was elected leader, sending a full tablet report...
I20260812 11:15:35.707206 6110 raft_consensus.cc:729] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fc29a0df6344635b1affcbdbce18a1e, State: Initialized, Role: FOLLOWER
I20260812 11:15:35.707998 6109 ts_tablet_manager.cc:1428] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53: Time spent starting tablet: real 0.015s user 0.015s sys 0.003s
I20260812 11:15:35.707952 6110 consensus_queue.cc:260] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fc29a0df6344635b1affcbdbce18a1e" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39235 } } peers { permanent_uuid: "dbebe6620bf9464eac3c7e7f6797df53" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43053 } } peers { permanent_uuid: "bc4fff7e1d5d4149b580bfe138c95923" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38091 } }
I20260812 11:15:35.709869 6110 ts_tablet_manager.cc:1428] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e: Time spent starting tablet: real 0.014s user 0.013s sys 0.002s
I20260812 11:15:35.814385 6115 raft_consensus.cc:482] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 11:15:35.814733 6115 raft_consensus.cc:504] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fc29a0df6344635b1affcbdbce18a1e" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39235 } } peers { permanent_uuid: "dbebe6620bf9464eac3c7e7f6797df53" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43053 } } peers { permanent_uuid: "bc4fff7e1d5d4149b580bfe138c95923" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38091 } }
I20260812 11:15:35.816659 6115 leader_election.cc:288] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fc29a0df6344635b1affcbdbce18a1e (127.4.26.65:39235), dbebe6620bf9464eac3c7e7f6797df53 (127.4.26.66:43053)
I20260812 11:15:35.822528 6105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.817331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:40119 (local address 127.4.26.66:43053)
0812 11:15:35.817611 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:35.817616 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:35.817654 (+ 38us) server_negotiation.cc:407] Connection header received
0812 11:15:35.817726 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:35.817730 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:35.817799 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:35.817877 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:35.818315 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.819055 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.820729 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.821587 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.821712 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.821822 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:35.822126 (+ 304us) server_negotiation.cc:299] Negotiation successful
0812 11:15:35.822264 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
I20260812 11:15:35.822551 6082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.817002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.66:43053 (local address 127.4.26.67:40119)
0812 11:15:35.817332 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:35.817354 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:35.817573 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:35.817948 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:35.817953 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:35.817981 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:35.818149 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:35.818158 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.819202 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.819206 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:35.820556 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:35.820569 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.821746 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.821752 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:35.821947 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.821973 (+ 26us) client_negotiation.cc:769] Sending connection context
0812 11:15:35.822062 (+ 89us) client_negotiation.cc:240] Negotiation successful
0812 11:15:35.822217 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193}
I20260812 11:15:35.823158 6106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.817252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.26.67:34645 (local address 127.4.26.65:39235)
0812 11:15:35.817442 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:35.817447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:35.817974 (+ 527us) server_negotiation.cc:407] Connection header received
0812 11:15:35.818242 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:35.818246 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:35.818318 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:35.818391 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0812 11:15:35.818955 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.819656 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.821412 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.822244 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.822364 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.822464 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:35.822821 (+ 357us) server_negotiation.cc:299] Negotiation successful
0812 11:15:35.822959 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 11:15:35.823747 6119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.817037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.65:39235 (local address 127.4.26.67:34645)
0812 11:15:35.817861 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0812 11:15:35.817876 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:15:35.818090 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:15:35.818423 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:15:35.818428 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:15:35.818451 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0812 11:15:35.818798 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:35.818807 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.819807 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.819811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:35.821223 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:15:35.821239 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.822419 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.822425 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:15:35.822601 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.822631 (+ 30us) client_negotiation.cc:769] Sending connection context
0812 11:15:35.823354 (+ 723us) client_negotiation.cc:240] Negotiation successful
0812 11:15:35.823488 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"spinlock_wait_cycles":45440,"thread_start_us":515,"threads_started":1}
I20260812 11:15:35.823712 5797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9c5a1e093b64627812f5ad0607ff25c" candidate_uuid: "bc4fff7e1d5d4149b580bfe138c95923" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbebe6620bf9464eac3c7e7f6797df53" is_pre_election: true
I20260812 11:15:35.824357 5797 raft_consensus.cc:2454] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc4fff7e1d5d4149b580bfe138c95923 in term 0.
I20260812 11:15:35.824944 5571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9c5a1e093b64627812f5ad0607ff25c" candidate_uuid: "bc4fff7e1d5d4149b580bfe138c95923" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fc29a0df6344635b1affcbdbce18a1e" is_pre_election: true
I20260812 11:15:35.825106 5906 leader_election.cc:302] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc4fff7e1d5d4149b580bfe138c95923, dbebe6620bf9464eac3c7e7f6797df53; no voters:
I20260812 11:15:35.825523 5571 raft_consensus.cc:2454] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc4fff7e1d5d4149b580bfe138c95923 in term 0.
I20260812 11:15:35.825582 6115 raft_consensus.cc:2781] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 11:15:35.825732 6115 raft_consensus.cc:482] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 11:15:35.825843 6115 raft_consensus.cc:3037] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:35.828267 6115 raft_consensus.cc:504] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fc29a0df6344635b1affcbdbce18a1e" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39235 } } peers { permanent_uuid: "dbebe6620bf9464eac3c7e7f6797df53" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43053 } } peers { permanent_uuid: "bc4fff7e1d5d4149b580bfe138c95923" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38091 } }
I20260812 11:15:35.828926 6115 leader_election.cc:288] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [CANDIDATE]: Term 1 election: Requested vote from peers 9fc29a0df6344635b1affcbdbce18a1e (127.4.26.65:39235), dbebe6620bf9464eac3c7e7f6797df53 (127.4.26.66:43053)
I20260812 11:15:35.829478 5571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9c5a1e093b64627812f5ad0607ff25c" candidate_uuid: "bc4fff7e1d5d4149b580bfe138c95923" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fc29a0df6344635b1affcbdbce18a1e"
I20260812 11:15:35.829558 5797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9c5a1e093b64627812f5ad0607ff25c" candidate_uuid: "bc4fff7e1d5d4149b580bfe138c95923" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbebe6620bf9464eac3c7e7f6797df53"
I20260812 11:15:35.829679 5571 raft_consensus.cc:3037] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:35.829789 5797 raft_consensus.cc:3037] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:35.832037 5571 raft_consensus.cc:2454] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc4fff7e1d5d4149b580bfe138c95923 in term 1.
I20260812 11:15:35.832142 5797 raft_consensus.cc:2454] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc4fff7e1d5d4149b580bfe138c95923 in term 1.
I20260812 11:15:35.832589 5909 leader_election.cc:302] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fc29a0df6344635b1affcbdbce18a1e, bc4fff7e1d5d4149b580bfe138c95923; no voters:
I20260812 11:15:35.832921 6115 raft_consensus.cc:2781] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:35.833417 6115 raft_consensus.cc:686] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [term 1 LEADER]: Becoming Leader. State: Replica: bc4fff7e1d5d4149b580bfe138c95923, State: Running, Role: LEADER
I20260812 11:15:35.834014 6115 consensus_queue.cc:237] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fc29a0df6344635b1affcbdbce18a1e" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39235 } } peers { permanent_uuid: "dbebe6620bf9464eac3c7e7f6797df53" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43053 } } peers { permanent_uuid: "bc4fff7e1d5d4149b580bfe138c95923" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38091 } }
I20260812 11:15:35.838899 5342 catalog_manager.cc:5495] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc4fff7e1d5d4149b580bfe138c95923 (127.4.26.67). New cstate: current_term: 1 leader_uuid: "bc4fff7e1d5d4149b580bfe138c95923" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fc29a0df6344635b1affcbdbce18a1e" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbebe6620bf9464eac3c7e7f6797df53" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc4fff7e1d5d4149b580bfe138c95923" member_type: VOTER last_known_addr { host: "127.4.26.67" port: 38091 } health_report { overall_health: HEALTHY } } }
W20260812 11:15:35.842383 6081 tablet.cc:2369] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:15:35.853360 5877 tablet.cc:2369] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 11:15:35.873247 5647 tablet.cc:2369] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:15:35.900655 6107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.895605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42604 (local address 127.4.26.67:38091)
0812 11:15:35.895796 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:35.895800 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:35.895837 (+ 37us) server_negotiation.cc:407] Connection header received
0812 11:15:35.895928 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:35.895931 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:35.896009 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:35.896139 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:15:35.896436 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.897226 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.898646 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.899102 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.899199 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.899664 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:15:35.900190 (+ 526us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:15:35.900305 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:35.900347 (+ 42us) server_negotiation.cc:299] Negotiation successful
0812 11:15:35.900413 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260812 11:15:35.908914 5797 raft_consensus.cc:1261] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53 [term 1 FOLLOWER]: Refusing update from remote peer bc4fff7e1d5d4149b580bfe138c95923: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:15:35.908955 5571 raft_consensus.cc:1261] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e [term 1 FOLLOWER]: Refusing update from remote peer bc4fff7e1d5d4149b580bfe138c95923: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:15:35.909839 6120 consensus_queue.cc:1035] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbebe6620bf9464eac3c7e7f6797df53" member_type: VOTER last_known_addr { host: "127.4.26.66" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:15:35.910228 6115 consensus_queue.cc:1035] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fc29a0df6344635b1affcbdbce18a1e" member_type: VOTER last_known_addr { host: "127.4.26.65" port: 39235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:15:35.940033 5342 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:15:35.940358 5342 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260812 11:15:35.944173 5342 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 08dff408f8f14df7a98f4a13529c6339: Sending DeleteTablet for 3 replicas of tablet b9c5a1e093b64627812f5ad0607ff25c
I20260812 11:15:35.945422 5538 tablet_service.cc:1514] Processing DeleteTablet for tablet b9c5a1e093b64627812f5ad0607ff25c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:35 UTC) from {username='slave'} at 127.0.0.1:55390
I20260812 11:15:35.945454 5758 tablet_service.cc:1514] Processing DeleteTablet for tablet b9c5a1e093b64627812f5ad0607ff25c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:35 UTC) from {username='slave'} at 127.0.0.1:59352
I20260812 11:15:35.946182 5980 tablet_service.cc:1514] Processing DeleteTablet for tablet b9c5a1e093b64627812f5ad0607ff25c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 11:15:35 UTC) from {username='slave'} at 127.0.0.1:42600
I20260812 11:15:35.947471 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 5436
I20260812 11:15:35.957844 6139 tablet_replica.cc:330] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e: stopping tablet replica
I20260812 11:15:35.958106 6140 tablet_replica.cc:330] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53: stopping tablet replica
I20260812 11:15:35.958389 6139 raft_consensus.cc:2229] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:15:35.958628 6140 raft_consensus.cc:2229] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 11:15:35.959147 6139 raft_consensus.cc:2258] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:15:35.959198 6140 raft_consensus.cc:2258] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:15:35.961607 6140 ts_tablet_manager.cc:1905] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:15:35.961599 6139 ts_tablet_manager.cc:1905] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:15:35.969089 6139 ts_tablet_manager.cc:1918] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:35.969132 6140 ts_tablet_manager.cc:1918] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:35.969326 6140 log.cc:1196] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-1/wal/wals/b9c5a1e093b64627812f5ad0607ff25c
I20260812 11:15:35.969374 6139 log.cc:1196] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-0/wal/wals/b9c5a1e093b64627812f5ad0607ff25c
I20260812 11:15:35.970036 6139 ts_tablet_manager.cc:1939] T b9c5a1e093b64627812f5ad0607ff25c P 9fc29a0df6344635b1affcbdbce18a1e: Deleting consensus metadata
I20260812 11:15:35.970041 6140 ts_tablet_manager.cc:1939] T b9c5a1e093b64627812f5ad0607ff25c P dbebe6620bf9464eac3c7e7f6797df53: Deleting consensus metadata
I20260812 11:15:35.972105 5317 catalog_manager.cc:4841] TS dbebe6620bf9464eac3c7e7f6797df53 (127.4.26.66:43053): tablet b9c5a1e093b64627812f5ad0607ff25c (table test-table [id=5717c6f965264e4e91a693da97e43c2d]) successfully deleted
I20260812 11:15:35.972726 5323 catalog_manager.cc:4841] TS 9fc29a0df6344635b1affcbdbce18a1e (127.4.26.65:39235): tablet b9c5a1e093b64627812f5ad0607ff25c (table test-table [id=5717c6f965264e4e91a693da97e43c2d]) successfully deleted
I20260812 11:15:35.973930 6141 tablet_replica.cc:330] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923: stopping tablet replica
I20260812 11:15:35.974450 6141 raft_consensus.cc:2229] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [term 1 LEADER]: Raft consensus shutting down.
I20260812 11:15:35.975179 6141 raft_consensus.cc:2258] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 11:15:35.977449 6141 ts_tablet_manager.cc:1905] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 11:15:35.979777 6106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:35.949126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55392 (local address 127.4.26.65:39235)
0812 11:15:35.949356 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:35.949364 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:35.973189 (+ 23825us) server_negotiation.cc:407] Connection header received
0812 11:15:35.973424 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:35.973430 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:35.973549 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:35.973640 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:35.974167 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.975084 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.976718 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:35.977124 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:35.977268 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:35.978353 (+ 1085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:35.978362 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:35.978377 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:35.978972 (+ 595us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:35.979023 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:35.979042 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:35.979143 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:35.979295 (+ 152us) server_negotiation.cc:299] Negotiation successful
0812 11:15:35.979413 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260812 11:15:35.980453 5637 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:35.985873 6141 ts_tablet_manager.cc:1918] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 11:15:35.986096 6141 log.cc:1196] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923: Deleting WAL directory at /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786532997575371-4201-0/minicluster-data/ts-2/wal/wals/b9c5a1e093b64627812f5ad0607ff25c
I20260812 11:15:35.986716 6141 ts_tablet_manager.cc:1939] T b9c5a1e093b64627812f5ad0607ff25c P bc4fff7e1d5d4149b580bfe138c95923: Deleting consensus metadata
I20260812 11:15:35.988799 5317 catalog_manager.cc:4841] TS bc4fff7e1d5d4149b580bfe138c95923 (127.4.26.67:38091): tablet b9c5a1e093b64627812f5ad0607ff25c (table test-table [id=5717c6f965264e4e91a693da97e43c2d]) successfully deleted
I20260812 11:15:36.083032 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 5436
I20260812 11:15:36.110597 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 5654
I20260812 11:15:36.119993 6105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:36.111499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59360 (local address 127.4.26.66:43053)
0812 11:15:36.111704 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:36.111710 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:36.111733 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:15:36.111863 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:36.111869 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:36.111979 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:36.112113 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:36.112531 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:36.113808 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:36.115834 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:36.116542 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:36.116699 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:36.118128 (+ 1429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:36.118141 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:36.118165 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:36.119028 (+ 863us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:36.119102 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:36.119149 (+ 47us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:36.119282 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:36.119462 (+ 180us) server_negotiation.cc:299] Negotiation successful
0812 11:15:36.119606 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260812 11:15:36.120806 5868 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:36.270213 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 5654
I20260812 11:15:36.290473 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 5882
I20260812 11:15:36.298887 6107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:36.291459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42610 (local address 127.4.26.67:38091)
0812 11:15:36.291653 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:36.291659 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:36.291685 (+ 26us) server_negotiation.cc:407] Connection header received
0812 11:15:36.291806 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:36.291810 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:36.291899 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:36.291988 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:36.292501 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:36.293390 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:36.295313 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:36.295790 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:36.295897 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:36.297347 (+ 1450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:36.297364 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:36.297384 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:36.298023 (+ 639us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:36.298082 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:36.298110 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:36.298231 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:36.298412 (+ 181us) server_negotiation.cc:299] Negotiation successful
0812 11:15:36.298513 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260812 11:15:36.299765 6071 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:36.425712 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 5882
I20260812 11:15:36.457626 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 5291
I20260812 11:15:36.458858 5386 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:36.569185 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 5291
2026-08-12T11:15:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3165 ms)
[----------] 6 tests from EncryptionPolicyTest (24511 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:15:36 dist-test-slave-rmhg krb5kdc[6153](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:15:36 dist-test-slave-rmhg krb5kdc[6153](info): set up 2 sockets
Aug 12 11:15:36 dist-test-slave-rmhg krb5kdc[6153](info): commencing operation
krb5kdc: starting...
W20260812 11:15:37.873867 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.246s user 0.002s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:15:38 dist-test-slave-rmhg krb5kdc[6153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:15:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:15:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:15:38.205008 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45853
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:38.571349 6173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:38.571702 6173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:38.571832 6173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:38.581728 6173 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:15:38.581936 6173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:38.582010 6173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:38.582093 6173 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:15:38.582150 6173 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:15:38.594861 6173 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45853
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:38.596406 6173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:38.598055 6173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:38.611065 6180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:38.611241 6182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:38.611212 6184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:38.612413 6173 server_base.cc:1034] running on GCE node
I20260812 11:15:38.613416 6173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:38.615157 6173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:38.616426 6173 hybrid_clock.cc:648] HybridClock initialized: now 1786533338616345 us; error 79 us; skew 500 ppm
I20260812 11:15:38.616851 6173 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:38 dist-test-slave-rmhg krb5kdc[6153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533338, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:38.624346 6173 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:15:38.626547 6173 webserver.cc:460] Webserver started at http://127.0.0.1:42141/ using document root <none> and password file <none>
I20260812 11:15:38.627477 6173 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:38.627631 6173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:38.627965 6173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:38.631660 6173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "77978735150e48d4ac51aa80ec0cb38f"
format_stamp: "Formatted at 2026-08-12 11:15:38 on dist-test-slave-rmhg"
server_key: "93f7bfb71acfd2c79d5bb81a5be3c969"
server_key_iv: "764729c715e7fd4ab8b9122ef93f8e17"
server_key_version: "encryptionkey@0"
I20260812 11:15:38.632602 6173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "77978735150e48d4ac51aa80ec0cb38f"
format_stamp: "Formatted at 2026-08-12 11:15:38 on dist-test-slave-rmhg"
server_key: "93f7bfb71acfd2c79d5bb81a5be3c969"
server_key_iv: "764729c715e7fd4ab8b9122ef93f8e17"
server_key_version: "encryptionkey@0"
I20260812 11:15:38.638940 6173 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260812 11:15:38.643637 6195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:38.645591 6173 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260812 11:15:38.645815 6173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "77978735150e48d4ac51aa80ec0cb38f"
format_stamp: "Formatted at 2026-08-12 11:15:38 on dist-test-slave-rmhg"
server_key: "93f7bfb71acfd2c79d5bb81a5be3c969"
server_key_iv: "764729c715e7fd4ab8b9122ef93f8e17"
server_key_version: "encryptionkey@0"
I20260812 11:15:38.646047 6173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:38.666489 6173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:38.671190 6173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:38.671494 6173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:38.690433 6173 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45853
I20260812 11:15:38.690456 6281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45853 every 8 connection(s)
I20260812 11:15:38.691906 6173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:15:38.695989 6283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:38.700126 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 6173
I20260812 11:15:38.700338 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:15:38.701010 4201 external_mini_cluster.cc:1428] Setting key b9dd959d30e5f8edb771923071c9e343
I20260812 11:15:38.709499 6283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f: Bootstrap starting.
I20260812 11:15:38.712822 6283 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:38.714001 6283 log.cc:824] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f: Log is configured to *not* fsync() on all Append() calls
Aug 12 11:15:38 dist-test-slave-rmhg krb5kdc[6153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 11:15:38.717340 6283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f: No bootstrap required, opened a new log
I20260812 11:15:38.725584 6286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:38.703109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57047 (local address 127.0.0.1:45853)
0812 11:15:38.703932 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:38.703946 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:38.704018 (+ 72us) server_negotiation.cc:407] Connection header received
0812 11:15:38.705769 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:38.705795 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:38.706265 (+ 470us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:38.706663 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:38.708347 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:38.709817 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:38.711146 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:38.711846 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:38.712039 (+ 193us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:38.716856 (+ 4817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:38.716865 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:38.716888 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:38.716937 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:38.720389 (+ 3452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:38.721607 (+ 1218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:38.721616 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:38.721624 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:38.721818 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:38.722384 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:38.722389 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:38.722391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:38.723065 (+ 674us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:38.723340 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:38.723923 (+ 583us) server_negotiation.cc:299] Negotiation successful
0812 11:15:38.724308 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":345,"threads_started":1}
I20260812 11:15:38.726449 6283 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77978735150e48d4ac51aa80ec0cb38f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45853 } }
I20260812 11:15:38.726845 6283 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:38.726953 6283 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77978735150e48d4ac51aa80ec0cb38f, State: Initialized, Role: FOLLOWER
I20260812 11:15:38.727581 6283 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77978735150e48d4ac51aa80ec0cb38f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45853 } }
I20260812 11:15:38.727829 6283 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:15:38.727968 6283 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:15:38.728145 6283 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:38.729995 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:15:38.730793 6283 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77978735150e48d4ac51aa80ec0cb38f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45853 } }
I20260812 11:15:38.731310 6283 leader_election.cc:302] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77978735150e48d4ac51aa80ec0cb38f; no voters:
I20260812 11:15:38.731906 6283 leader_election.cc:288] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:15:38.732095 6290 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:38.734117 6283 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:15:38.737821 6290 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [term 1 LEADER]: Becoming Leader. State: Replica: 77978735150e48d4ac51aa80ec0cb38f, State: Running, Role: LEADER
I20260812 11:15:38.738752 6290 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77978735150e48d4ac51aa80ec0cb38f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45853 } }
I20260812 11:15:38.742455 6292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77978735150e48d4ac51aa80ec0cb38f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77978735150e48d4ac51aa80ec0cb38f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45853 } } }
I20260812 11:15:38.742920 6292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:38.743454 6294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77978735150e48d4ac51aa80ec0cb38f. Latest consensus state: current_term: 1 leader_uuid: "77978735150e48d4ac51aa80ec0cb38f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77978735150e48d4ac51aa80ec0cb38f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45853 } } }
I20260812 11:15:38.743747 6294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:38.751842 6322 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:15:38.758703 6322 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:15:38.768440 6286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:38.741416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59187 (local address 127.0.0.1:45853)
0812 11:15:38.745136 (+ 3720us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:38.745144 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:38.752295 (+ 7151us) server_negotiation.cc:407] Connection header received
0812 11:15:38.752483 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:38.752489 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:38.752578 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:38.752692 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:38.754979 (+ 2287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:38.755964 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:38.757436 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:38.757963 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:38.758082 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:38.760830 (+ 2748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:38.760835 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:38.760839 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:38.760879 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:38.764512 (+ 3633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:38.765809 (+ 1297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:38.765815 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:38.765817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:38.765982 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:38.766549 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:38.766553 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:38.766555 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:38.766955 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:38.767367 (+ 412us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:38.767864 (+ 497us) server_negotiation.cc:299] Negotiation successful
0812 11:15:38.768039 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3549}
I20260812 11:15:38.771004 6322 catalog_manager.cc:1347] Generated new cluster ID: 869fabe6c9424acb8ebe7fb56a60919e
I20260812 11:15:38.771142 6322 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:15:38.783011 6322 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:15:38.784610 6322 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:15:38.795475 6322 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77978735150e48d4ac51aa80ec0cb38f: Generated new TSK 0
I20260812 11:15:38.796605 6322 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:15:38.802992 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 6173
I20260812 11:15:38.805509 6275 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:38.897867 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 6173
W20260812 11:15:38.925295 6150 connection.cc:535] client connection to 127.0.0.1:45853 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45853): Connection reset by peer (error 104)
2026-08-12T11:15:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2317 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:15:39 dist-test-slave-rmhg krb5kdc[6336](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:15:39 dist-test-slave-rmhg krb5kdc[6336](info): set up 2 sockets
Aug 12 11:15:39 dist-test-slave-rmhg krb5kdc[6336](info): commencing operation
krb5kdc: starting...
W20260812 11:15:40.181754 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.008s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:15:40 dist-test-slave-rmhg krb5kdc[6336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533340, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:15:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:15:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:15:40.520607 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39867
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44393
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39867
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:40.887208 6353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:40.887544 6353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:40.887688 6353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:40.895316 6353 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:15:40.895452 6353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:40.895510 6353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:40.895612 6353 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:15:40.895666 6353 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:15:40.906142 6353 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44393
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39867
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:40.907584 6353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:40.908968 6353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:40.921224 6358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:40.921187 6366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:40.921255 6360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:40.922473 6353 server_base.cc:1034] running on GCE node
I20260812 11:15:40.923318 6353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:40.924929 6353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:40.926151 6353 hybrid_clock.cc:648] HybridClock initialized: now 1786533340926093 us; error 50 us; skew 500 ppm
I20260812 11:15:40.926522 6353 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:40 dist-test-slave-rmhg krb5kdc[6336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533340, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:40.929989 6353 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:15:40.931744 6353 webserver.cc:460] Webserver started at http://127.0.0.1:35697/ using document root <none> and password file <none>
I20260812 11:15:40.932458 6353 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:40.932579 6353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:40.932889 6353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:40.936094 6353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "4c2c70a3e2f14a2fa3f15a3c4ecaa566"
format_stamp: "Formatted at 2026-08-12 11:15:40 on dist-test-slave-rmhg"
server_key: "beb6923b1e2cc77193da2a8de1f2e600"
server_key_iv: "a9f0420bebc180d68f45f5d79965f70c"
server_key_version: "encryptionkey@0"
I20260812 11:15:40.936885 6353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "4c2c70a3e2f14a2fa3f15a3c4ecaa566"
format_stamp: "Formatted at 2026-08-12 11:15:40 on dist-test-slave-rmhg"
server_key: "beb6923b1e2cc77193da2a8de1f2e600"
server_key_iv: "a9f0420bebc180d68f45f5d79965f70c"
server_key_version: "encryptionkey@0"
I20260812 11:15:40.942530 6353 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260812 11:15:40.946376 6377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:40.947788 6353 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:15:40.947962 6353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "4c2c70a3e2f14a2fa3f15a3c4ecaa566"
format_stamp: "Formatted at 2026-08-12 11:15:40 on dist-test-slave-rmhg"
server_key: "beb6923b1e2cc77193da2a8de1f2e600"
server_key_iv: "a9f0420bebc180d68f45f5d79965f70c"
server_key_version: "encryptionkey@0"
I20260812 11:15:40.948163 6353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:40.964576 6353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:40.969360 6353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:40.969672 6353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:40.988339 6353 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39867
I20260812 11:15:40.988361 6470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39867 every 8 connection(s)
I20260812 11:15:40.989996 6353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:15:40.994215 6472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:40.995060 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 6353
I20260812 11:15:40.995260 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:15:40.995714 4201 external_mini_cluster.cc:1428] Setting key 949cb8113406ed5bb9f000a7cbd8cc2a
I20260812 11:15:41.010282 6472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566: Bootstrap starting.
I20260812 11:15:41.012777 6477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:40.997830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57743 (local address 127.0.0.1:39867)
0812 11:15:40.998722 (+ 892us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:40.998739 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:40.998798 (+ 59us) server_negotiation.cc:407] Connection header received
0812 11:15:41.001186 (+ 2388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:41.001226 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:41.001903 (+ 677us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:41.002456 (+ 553us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:41.003027 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:41.004968 (+ 1941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:41.006588 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:41.007855 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:41.008080 (+ 225us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:41.009633 (+ 1553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:41.009646 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:41.009671 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:41.010462 (+ 791us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:41.010587 (+ 125us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:41.010626 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:41.010810 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:41.011128 (+ 318us) server_negotiation.cc:299] Negotiation successful
0812 11:15:41.011343 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":361,"threads_started":1}
I20260812 11:15:41.014427 6472 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:41.015653 6472 log.cc:824] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:41.017289 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:15:41.019002 6472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566: No bootstrap required, opened a new log
I20260812 11:15:41.027480 6472 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c2c70a3e2f14a2fa3f15a3c4ecaa566" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39867 } }
I20260812 11:15:41.027940 6472 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:41.028184 6472 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c2c70a3e2f14a2fa3f15a3c4ecaa566, State: Initialized, Role: FOLLOWER
I20260812 11:15:41.028362 6477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:41.021806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34563 (local address 127.0.0.1:39867)
0812 11:15:41.022006 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:41.022013 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:41.022391 (+ 378us) server_negotiation.cc:407] Connection header received
0812 11:15:41.022567 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:41.022571 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:41.022638 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:41.022731 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:41.023305 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:41.024122 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:41.025610 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:41.026102 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:41.026233 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:41.027438 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:41.027443 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:41.027446 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:41.027470 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:41.027529 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:41.027546 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:41.027638 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:41.027850 (+ 212us) server_negotiation.cc:299] Negotiation successful
0812 11:15:41.027908 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:15:41.029012 6472 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c2c70a3e2f14a2fa3f15a3c4ecaa566" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39867 } }
I20260812 11:15:41.029348 6472 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:15:41.029507 6472 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:15:41.029678 6472 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:41.032006 6472 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c2c70a3e2f14a2fa3f15a3c4ecaa566" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39867 } }
I20260812 11:15:41.032660 6472 leader_election.cc:302] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c2c70a3e2f14a2fa3f15a3c4ecaa566; no voters:
I20260812 11:15:41.033315 6472 leader_election.cc:288] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:15:41.033424 6485 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:41.034122 6485 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [term 1 LEADER]: Becoming Leader. State: Replica: 4c2c70a3e2f14a2fa3f15a3c4ecaa566, State: Running, Role: LEADER
I20260812 11:15:41.034684 6485 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c2c70a3e2f14a2fa3f15a3c4ecaa566" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39867 } }
I20260812 11:15:41.035431 6472 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:15:41.037657 6491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c2c70a3e2f14a2fa3f15a3c4ecaa566. Latest consensus state: current_term: 1 leader_uuid: "4c2c70a3e2f14a2fa3f15a3c4ecaa566" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c2c70a3e2f14a2fa3f15a3c4ecaa566" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39867 } } }
I20260812 11:15:41.037760 6487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c2c70a3e2f14a2fa3f15a3c4ecaa566" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c2c70a3e2f14a2fa3f15a3c4ecaa566" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39867 } } }
I20260812 11:15:41.038076 6491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:41.038121 6487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:41.041831 6499 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:15:41.048125 6499 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:15:41.058195 6499 catalog_manager.cc:1347] Generated new cluster ID: bd5fefa342c24f7799071791903117e3
I20260812 11:15:41.058333 6499 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:15:41.080861 6499 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:15:41.082399 6499 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:15:41.094734 6499 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c2c70a3e2f14a2fa3f15a3c4ecaa566: Generated new TSK 0
I20260812 11:15:41.095662 6499 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:15:41.111872 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 6353
W20260812 11:15:41.113718 6463 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:57743
W20260812 11:15:41.114560 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 6353: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:15:41.114742 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 6353
W20260812 11:15:41.139392 6331 connection.cc:535] client connection to 127.0.0.1:39867 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39867): Connection reset by peer (error 104)
2026-08-12T11:15:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2214 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:15:41 dist-test-slave-rmhg krb5kdc[6524](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:15:41 dist-test-slave-rmhg krb5kdc[6524](info): set up 2 sockets
Aug 12 11:15:41 dist-test-slave-rmhg krb5kdc[6524](info): commencing operation
krb5kdc: starting...
W20260812 11:15:42.405079 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.246s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:15:42 dist-test-slave-rmhg krb5kdc[6524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533342, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:15:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:15:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:15:42.744072 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40687
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:43.105856 6554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:43.106210 6554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:43.106359 6554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:43.113896 6554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:15:43.114053 6554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:43.114140 6554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:43.114220 6554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:15:43.114282 6554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:15:43.124907 6554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40687
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:43.126504 6554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:43.128031 6554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:43.142218 6560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:43.142163 6566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:43.142206 6568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:43.146926 6554 server_base.cc:1034] running on GCE node
I20260812 11:15:43.147921 6554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:43.149603 6554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:43.150849 6554 hybrid_clock.cc:648] HybridClock initialized: now 1786533343150796 us; error 55 us; skew 500 ppm
I20260812 11:15:43.151257 6554 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:43 dist-test-slave-rmhg krb5kdc[6524](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533343, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:43.154773 6554 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:15:43.156625 6554 webserver.cc:460] Webserver started at http://127.0.0.1:44581/ using document root <none> and password file <none>
I20260812 11:15:43.157536 6554 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:43.157683 6554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:43.158002 6554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:43.161367 6554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "1df976a774a14ed39e94fa8262c5886b"
format_stamp: "Formatted at 2026-08-12 11:15:43 on dist-test-slave-rmhg"
server_key: "0d8939da0c24c8324c5d37ac29395ae5"
server_key_iv: "2cff2cea30d15a9323f601d7394ac0cc"
server_key_version: "encryptionkey@0"
I20260812 11:15:43.162240 6554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "1df976a774a14ed39e94fa8262c5886b"
format_stamp: "Formatted at 2026-08-12 11:15:43 on dist-test-slave-rmhg"
server_key: "0d8939da0c24c8324c5d37ac29395ae5"
server_key_iv: "2cff2cea30d15a9323f601d7394ac0cc"
server_key_version: "encryptionkey@0"
I20260812 11:15:43.167989 6554 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260812 11:15:43.171891 6578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:43.173516 6554 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 11:15:43.173781 6554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "1df976a774a14ed39e94fa8262c5886b"
format_stamp: "Formatted at 2026-08-12 11:15:43 on dist-test-slave-rmhg"
server_key: "0d8939da0c24c8324c5d37ac29395ae5"
server_key_iv: "2cff2cea30d15a9323f601d7394ac0cc"
server_key_version: "encryptionkey@0"
I20260812 11:15:43.174015 6554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:43.180459 6554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:43.184844 6554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:43.185181 6554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:43.204037 6554 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40687
I20260812 11:15:43.204094 6665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40687 every 8 connection(s)
I20260812 11:15:43.205699 6554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:15:43.208767 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 6554
I20260812 11:15:43.208976 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:15:43.209599 4201 external_mini_cluster.cc:1428] Setting key 27a313f0260ee21866771d86031370cf
I20260812 11:15:43.210393 6666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:43.218278 6676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:43.211751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54267 (local address 127.0.0.1:40687)
0812 11:15:43.212607 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:43.212621 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:43.212670 (+ 49us) server_negotiation.cc:407] Connection header received
0812 11:15:43.214310 (+ 1640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:43.214336 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:43.214745 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:43.215157 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:43.216381 (+ 1224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:43.216389 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:43.216404 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:43.216429 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:43.216509 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:43.216531 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:43.216794 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:43.216931 (+ 137us) server_negotiation.cc:299] Negotiation successful
0812 11:15:43.217221 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":362,"threads_started":1}
I20260812 11:15:43.222654 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:15:43.225368 6666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b: Bootstrap starting.
I20260812 11:15:43.229669 6666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:43.230780 6676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:43.228216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35885 (local address 127.0.0.1:40687)
0812 11:15:43.228414 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:43.228421 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:43.228787 (+ 366us) server_negotiation.cc:407] Connection header received
0812 11:15:43.228937 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:43.228942 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:43.229008 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:43.229135 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:43.230162 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:43.230169 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:43.230174 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:43.230196 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:43.230246 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:43.230266 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:43.230387 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:43.230432 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 11:15:43.230491 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260812 11:15:43.231204 6666 log.cc:824] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:43.234601 6666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b: No bootstrap required, opened a new log
I20260812 11:15:43.242789 6666 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1df976a774a14ed39e94fa8262c5886b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40687 } }
I20260812 11:15:43.243232 6666 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:43.243345 6666 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1df976a774a14ed39e94fa8262c5886b, State: Initialized, Role: FOLLOWER
I20260812 11:15:43.244029 6666 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1df976a774a14ed39e94fa8262c5886b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40687 } }
I20260812 11:15:43.244274 6666 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:15:43.244450 6666 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:15:43.244638 6666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:43.247092 6666 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1df976a774a14ed39e94fa8262c5886b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40687 } }
I20260812 11:15:43.247732 6666 leader_election.cc:302] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1df976a774a14ed39e94fa8262c5886b; no voters:
I20260812 11:15:43.248404 6666 leader_election.cc:288] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:15:43.248616 6687 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:43.249884 6687 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [term 1 LEADER]: Becoming Leader. State: Replica: 1df976a774a14ed39e94fa8262c5886b, State: Running, Role: LEADER
I20260812 11:15:43.250842 6666 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:15:43.250787 6687 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1df976a774a14ed39e94fa8262c5886b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40687 } }
I20260812 11:15:43.253820 6691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1df976a774a14ed39e94fa8262c5886b. Latest consensus state: current_term: 1 leader_uuid: "1df976a774a14ed39e94fa8262c5886b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1df976a774a14ed39e94fa8262c5886b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40687 } } }
I20260812 11:15:43.253916 6689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1df976a774a14ed39e94fa8262c5886b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1df976a774a14ed39e94fa8262c5886b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40687 } } }
I20260812 11:15:43.254407 6691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:43.254419 6689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:43.256428 6708 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:15:43.262104 6708 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:15:43.271905 6708 catalog_manager.cc:1347] Generated new cluster ID: 59e7899ed82f490caf82c2768b7a153f
I20260812 11:15:43.272051 6708 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:15:43.299230 6708 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:15:43.299737 6708 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:15:43.318255 6708 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1df976a774a14ed39e94fa8262c5886b: Generated new TSK 0
I20260812 11:15:43.319535 6708 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:15:43.337407 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 6554
W20260812 11:15:43.338779 6660 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54267
W20260812 11:15:43.339707 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 6554: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:15:43.339874 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 6554
2026-08-12T11:15:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2230 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:15:43 dist-test-slave-rmhg krb5kdc[6723](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:15:43 dist-test-slave-rmhg krb5kdc[6723](info): set up 2 sockets
Aug 12 11:15:43 dist-test-slave-rmhg krb5kdc[6723](info): commencing operation
krb5kdc: starting...
W20260812 11:15:44.634613 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.245s user 0.001s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:15:44 dist-test-slave-rmhg krb5kdc[6723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:15:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:15:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:15:44.973385 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41635
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41635
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:45.329913 6753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:45.330255 6753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:45.330400 6753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:45.337913 6753 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:15:45.338060 6753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:45.338152 6753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:45.338243 6753 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:15:45.338304 6753 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:15:45.348562 6753 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41635
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:45.349939 6753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:45.351272 6753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:45.362843 6761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:45.363250 6760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:45.363296 6766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:45.363821 6753 server_base.cc:1034] running on GCE node
I20260812 11:15:45.364631 6753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:45.366101 6753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:45.367336 6753 hybrid_clock.cc:648] HybridClock initialized: now 1786533345367273 us; error 48 us; skew 500 ppm
I20260812 11:15:45.367739 6753 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:45 dist-test-slave-rmhg krb5kdc[6723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533345, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:45.376006 6753 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:15:45.378095 6753 webserver.cc:460] Webserver started at http://127.0.0.1:33975/ using document root <none> and password file <none>
I20260812 11:15:45.378865 6753 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:45.379009 6753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:45.379328 6753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:45.382651 6753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "5ca359b6cd92437daba082d367bc3091"
format_stamp: "Formatted at 2026-08-12 11:15:45 on dist-test-slave-rmhg"
server_key: "14516650b4f2d6a6560f120805ea1244"
server_key_iv: "967d731b09629539f517e702393e490a"
server_key_version: "encryptionkey@0"
I20260812 11:15:45.383499 6753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "5ca359b6cd92437daba082d367bc3091"
format_stamp: "Formatted at 2026-08-12 11:15:45 on dist-test-slave-rmhg"
server_key: "14516650b4f2d6a6560f120805ea1244"
server_key_iv: "967d731b09629539f517e702393e490a"
server_key_version: "encryptionkey@0"
I20260812 11:15:45.389501 6753 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:15:45.393543 6777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:45.395083 6753 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:15:45.395284 6753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "5ca359b6cd92437daba082d367bc3091"
format_stamp: "Formatted at 2026-08-12 11:15:45 on dist-test-slave-rmhg"
server_key: "14516650b4f2d6a6560f120805ea1244"
server_key_iv: "967d731b09629539f517e702393e490a"
server_key_version: "encryptionkey@0"
I20260812 11:15:45.395488 6753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:45.421715 6753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:45.426218 6753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:45.426499 6753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:45.446026 6753 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41635
I20260812 11:15:45.446066 6866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41635 every 8 connection(s)
I20260812 11:15:45.447541 6753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:15:45.451838 6868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:45.457453 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 6753
I20260812 11:15:45.457620 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:15:45.458081 4201 external_mini_cluster.cc:1428] Setting key 3e7b4c7a9ed8fc8c7c2538222fc0386e
I20260812 11:15:45.465348 6868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091: Bootstrap starting.
I20260812 11:15:45.469573 6868 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:45.470912 6868 log.cc:824] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:45.474350 6868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091: No bootstrap required, opened a new log
Aug 12 11:15:45 dist-test-slave-rmhg krb5kdc[6723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 11:15:45.484908 6868 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ca359b6cd92437daba082d367bc3091" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41635 } }
I20260812 11:15:45.485488 6868 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:45.485608 6868 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca359b6cd92437daba082d367bc3091, State: Initialized, Role: FOLLOWER
I20260812 11:15:45.486404 6868 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ca359b6cd92437daba082d367bc3091" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41635 } }
I20260812 11:15:45.486672 6873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:45.460017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58137 (local address 127.0.0.1:41635)
0812 11:15:45.461219 (+ 1202us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:45.461243 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:45.461307 (+ 64us) server_negotiation.cc:407] Connection header received
0812 11:15:45.463914 (+ 2607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:45.463950 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:45.464614 (+ 664us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:45.465141 (+ 527us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:45.466660 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:45.468813 (+ 2153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:45.470360 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:45.471531 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:45.471777 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:45.476492 (+ 4715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:45.476505 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:45.476529 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:45.476585 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:45.480977 (+ 4392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:45.481982 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:45.481993 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:45.482005 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:45.482305 (+ 300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:45.482833 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:45.482839 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:45.482842 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:45.483710 (+ 868us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:45.484026 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:45.484554 (+ 528us) server_negotiation.cc:299] Negotiation successful
0812 11:15:45.485077 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":784,"thread_start_us":487,"threads_started":1}
I20260812 11:15:45.486752 6868 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:15:45.486904 6868 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:15:45.487099 6868 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:45.490258 6868 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ca359b6cd92437daba082d367bc3091" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41635 } }
I20260812 11:15:45.490932 6868 leader_election.cc:302] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ca359b6cd92437daba082d367bc3091; no voters:
I20260812 11:15:45.491439 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:15:45.491680 6868 leader_election.cc:288] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:15:45.491812 6876 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:45.493425 6876 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca359b6cd92437daba082d367bc3091, State: Running, Role: LEADER
I20260812 11:15:45.493880 6868 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:15:45.494248 6876 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ca359b6cd92437daba082d367bc3091" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41635 } }
I20260812 11:15:45.497480 6878 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ca359b6cd92437daba082d367bc3091" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ca359b6cd92437daba082d367bc3091" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41635 } } }
I20260812 11:15:45.497991 6878 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:45.498621 6879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ca359b6cd92437daba082d367bc3091. Latest consensus state: current_term: 1 leader_uuid: "5ca359b6cd92437daba082d367bc3091" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ca359b6cd92437daba082d367bc3091" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41635 } } }
I20260812 11:15:45.498962 6879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:45.502408 6893 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:15:45.508399 6893 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:15:45.519397 6893 catalog_manager.cc:1347] Generated new cluster ID: fcfd64cc36154eaaa81df01ff92917a0
I20260812 11:15:45.519618 6893 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:15:45.520310 6873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:45.502409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33643 (local address 127.0.0.1:41635)
0812 11:15:45.502596 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:45.502602 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:45.502720 (+ 118us) server_negotiation.cc:407] Connection header received
0812 11:15:45.503036 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:45.503041 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:45.503130 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:45.503241 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:45.505482 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:45.506240 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:45.508141 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:45.508958 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:45.509113 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:45.512224 (+ 3111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:45.512231 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:45.512235 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:45.512290 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:45.516165 (+ 3875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:45.517240 (+ 1075us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:45.517246 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:45.517250 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:45.517414 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:45.517923 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:45.517929 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:45.517932 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:45.518371 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:45.518627 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:45.519689 (+ 1062us) server_negotiation.cc:299] Negotiation successful
0812 11:15:45.519952 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 11:15:45.533566 6893 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:15:45.535624 6893 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:15:45.548218 6893 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ca359b6cd92437daba082d367bc3091: Generated new TSK 0
I20260812 11:15:45.549549 6893 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:15:45.557890 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 6753
I20260812 11:15:45.558990 6860 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:45.650465 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 6753
2026-08-12T11:15:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2305 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:15:45 dist-test-slave-rmhg krb5kdc[6916](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:15:45 dist-test-slave-rmhg krb5kdc[6916](info): set up 2 sockets
Aug 12 11:15:45 dist-test-slave-rmhg krb5kdc[6916](info): commencing operation
krb5kdc: starting...
W20260812 11:15:46.953958 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.003s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:15:47 dist-test-slave-rmhg krb5kdc[6916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533347, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:15:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:15:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:15:47.288229 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35013
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35013
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:47.649088 6939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:47.649454 6939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:47.649569 6939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:47.657356 6939 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:15:47.657493 6939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:47.657539 6939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:47.657600 6939 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:15:47.657644 6939 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:15:47.667752 6939 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35013
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35013
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:47.669116 6939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:47.670563 6939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:47.682797 6946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:47.682776 6948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:47.682760 6952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:47.683772 6939 server_base.cc:1034] running on GCE node
I20260812 11:15:47.684619 6939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:47.686159 6939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:47.687382 6939 hybrid_clock.cc:648] HybridClock initialized: now 1786533347687333 us; error 42 us; skew 500 ppm
I20260812 11:15:47.687784 6939 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:47 dist-test-slave-rmhg krb5kdc[6916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533347, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:47.690995 6939 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:15:47.692533 6939 webserver.cc:460] Webserver started at http://127.0.0.1:35495/ using document root <none> and password file <none>
I20260812 11:15:47.693253 6939 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:47.693360 6939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:47.693670 6939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:47.696679 6939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "b1bdc1a0a1944ba9969ce9be0741ca0f"
format_stamp: "Formatted at 2026-08-12 11:15:47 on dist-test-slave-rmhg"
server_key: "a5b9a6d8d036b59e565843ddb6e4d24a"
server_key_iv: "369f73c1da3ad6e57494f133de80ec0a"
server_key_version: "encryptionkey@0"
I20260812 11:15:47.697482 6939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "b1bdc1a0a1944ba9969ce9be0741ca0f"
format_stamp: "Formatted at 2026-08-12 11:15:47 on dist-test-slave-rmhg"
server_key: "a5b9a6d8d036b59e565843ddb6e4d24a"
server_key_iv: "369f73c1da3ad6e57494f133de80ec0a"
server_key_version: "encryptionkey@0"
I20260812 11:15:47.702775 6939 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260812 11:15:47.706483 6971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:47.708003 6939 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:15:47.708186 6939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "b1bdc1a0a1944ba9969ce9be0741ca0f"
format_stamp: "Formatted at 2026-08-12 11:15:47 on dist-test-slave-rmhg"
server_key: "a5b9a6d8d036b59e565843ddb6e4d24a"
server_key_iv: "369f73c1da3ad6e57494f133de80ec0a"
server_key_version: "encryptionkey@0"
I20260812 11:15:47.708387 6939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:47.732506 6939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:47.737131 6939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:47.737464 6939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:47.755932 6939 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35013
I20260812 11:15:47.755962 7049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35013 every 8 connection(s)
I20260812 11:15:47.757434 6939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:15:47.761583 7050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:47.762255 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 6939
I20260812 11:15:47.762451 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:15:47.763042 4201 external_mini_cluster.cc:1428] Setting key 8f938cf2fa1c9fb47c7269f79ccef860
I20260812 11:15:47.776660 7050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f: Bootstrap starting.
I20260812 11:15:47.778405 7057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:47.765215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60523 (local address 127.0.0.1:35013)
0812 11:15:47.766106 (+ 891us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:47.766119 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:47.766171 (+ 52us) server_negotiation.cc:407] Connection header received
0812 11:15:47.768378 (+ 2207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:47.768416 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:47.768996 (+ 580us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:47.769465 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:47.770194 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:47.771555 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:47.773562 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:47.774355 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:47.774501 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:47.775859 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:47.775867 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:47.775885 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:47.776492 (+ 607us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:47.776582 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:47.776609 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:47.776719 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:47.776978 (+ 259us) server_negotiation.cc:299] Negotiation successful
0812 11:15:47.777285 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":396,"threads_started":1}
I20260812 11:15:47.780226 7050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:47.781479 7050 log.cc:824] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:47.782526 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:15:47.785046 7050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f: No bootstrap required, opened a new log
I20260812 11:15:47.795197 7057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:47.788301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52135 (local address 127.0.0.1:35013)
0812 11:15:47.788463 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:47.788468 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:47.788914 (+ 446us) server_negotiation.cc:407] Connection header received
0812 11:15:47.789104 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:47.789108 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:47.789218 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:47.789309 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:47.789987 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:47.790726 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:47.792648 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:47.793128 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:47.793303 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:47.794449 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:47.794454 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:47.794457 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:47.794481 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:47.794522 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:47.794540 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:47.794614 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:47.794760 (+ 146us) server_negotiation.cc:299] Negotiation successful
0812 11:15:47.794848 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260812 11:15:47.795962 7050 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1bdc1a0a1944ba9969ce9be0741ca0f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35013 } }
I20260812 11:15:47.796504 7050 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:47.796630 7050 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1bdc1a0a1944ba9969ce9be0741ca0f, State: Initialized, Role: FOLLOWER
I20260812 11:15:47.797343 7050 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1bdc1a0a1944ba9969ce9be0741ca0f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35013 } }
I20260812 11:15:47.797570 7050 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:15:47.797675 7050 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:15:47.797812 7050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:47.800468 7050 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1bdc1a0a1944ba9969ce9be0741ca0f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35013 } }
I20260812 11:15:47.801012 7050 leader_election.cc:302] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1bdc1a0a1944ba9969ce9be0741ca0f; no voters:
I20260812 11:15:47.801640 7050 leader_election.cc:288] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:15:47.801795 7066 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:47.802421 7066 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [term 1 LEADER]: Becoming Leader. State: Replica: b1bdc1a0a1944ba9969ce9be0741ca0f, State: Running, Role: LEADER
I20260812 11:15:47.803124 7066 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1bdc1a0a1944ba9969ce9be0741ca0f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35013 } }
I20260812 11:15:47.803902 7050 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:15:47.805984 7069 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1bdc1a0a1944ba9969ce9be0741ca0f. Latest consensus state: current_term: 1 leader_uuid: "b1bdc1a0a1944ba9969ce9be0741ca0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1bdc1a0a1944ba9969ce9be0741ca0f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35013 } } }
I20260812 11:15:47.806375 7069 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:47.806947 7067 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1bdc1a0a1944ba9969ce9be0741ca0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1bdc1a0a1944ba9969ce9be0741ca0f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35013 } } }
I20260812 11:15:47.807258 7067 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:47.807360 7076 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:15:47.814482 7076 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:15:47.824815 7076 catalog_manager.cc:1347] Generated new cluster ID: ec2d12e34bc34d5f822c54fe82446a06
I20260812 11:15:47.824954 7076 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:15:47.844265 7076 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:15:47.845739 7076 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:15:47.860765 7076 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1bdc1a0a1944ba9969ce9be0741ca0f: Generated new TSK 0
I20260812 11:15:47.861802 7076 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:15:47.882189 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 6939
W20260812 11:15:47.883843 7045 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:60523
W20260812 11:15:47.884581 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 6939: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:15:47.884712 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 6939
2026-08-12T11:15:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2235 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:15:48 dist-test-slave-rmhg krb5kdc[7106](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:15:48 dist-test-slave-rmhg krb5kdc[7106](info): set up 2 sockets
Aug 12 11:15:48 dist-test-slave-rmhg krb5kdc[7106](info): commencing operation
krb5kdc: starting...
W20260812 11:15:49.161707 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.002s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:15:49 dist-test-slave-rmhg krb5kdc[7106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:15:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:15:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:15:49.494513 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36543
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36543
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:49.850121 7124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:49.850464 7124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:49.850569 7124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:49.858021 7124 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:15:49.858160 7124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:49.858207 7124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:49.858268 7124 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:15:49.858312 7124 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:15:49.868657 7124 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:49.870021 7124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:49.871359 7124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:49.883672 7133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:49.883695 7132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:49.883611 7139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:49.884146 7124 server_base.cc:1034] running on GCE node
I20260812 11:15:49.885123 7124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:49.886685 7124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:49.887941 7124 hybrid_clock.cc:648] HybridClock initialized: now 1786533349887864 us; error 53 us; skew 500 ppm
I20260812 11:15:49.888315 7124 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:49 dist-test-slave-rmhg krb5kdc[7106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533349, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:49.891634 7124 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:15:49.893299 7124 webserver.cc:460] Webserver started at http://127.0.0.1:45497/ using document root <none> and password file <none>
I20260812 11:15:49.894071 7124 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:49.894207 7124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:49.894528 7124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:49.897863 7124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "c1ff6cc7237e47919207e5215a306551"
format_stamp: "Formatted at 2026-08-12 11:15:49 on dist-test-slave-rmhg"
server_key: "df46663e108975dc7eafa797b90cb806"
server_key_iv: "dd17cf583d8f5a6b5becbc1c241de7ed"
server_key_version: "encryptionkey@0"
I20260812 11:15:49.898720 7124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "c1ff6cc7237e47919207e5215a306551"
format_stamp: "Formatted at 2026-08-12 11:15:49 on dist-test-slave-rmhg"
server_key: "df46663e108975dc7eafa797b90cb806"
server_key_iv: "dd17cf583d8f5a6b5becbc1c241de7ed"
server_key_version: "encryptionkey@0"
I20260812 11:15:49.904670 7124 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 11:15:49.908736 7151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:49.910429 7124 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:15:49.910640 7124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "c1ff6cc7237e47919207e5215a306551"
format_stamp: "Formatted at 2026-08-12 11:15:49 on dist-test-slave-rmhg"
server_key: "df46663e108975dc7eafa797b90cb806"
server_key_iv: "dd17cf583d8f5a6b5becbc1c241de7ed"
server_key_version: "encryptionkey@0"
I20260812 11:15:49.910871 7124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:49.917363 7124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:49.922324 7124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:49.922667 7124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:49.941638 7124 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36543
I20260812 11:15:49.941690 7232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36543 every 8 connection(s)
I20260812 11:15:49.943149 7124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:15:49.947304 7233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:49.947688 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 7124
I20260812 11:15:49.947886 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:15:49.948498 4201 external_mini_cluster.cc:1428] Setting key f56c4c143aa35ff654858dbd9326922c
I20260812 11:15:49.957448 7240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:49.950531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53453 (local address 127.0.0.1:36543)
0812 11:15:49.951389 (+ 858us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:49.951401 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:49.951443 (+ 42us) server_negotiation.cc:407] Connection header received
0812 11:15:49.953872 (+ 2429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:49.953899 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:49.954299 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:49.954698 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:49.955733 (+ 1035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:49.955740 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:49.955754 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:49.955771 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:49.955835 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:49.955868 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:49.956109 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:49.956244 (+ 135us) server_negotiation.cc:299] Negotiation successful
0812 11:15:49.956426 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":365,"threads_started":1}
I20260812 11:15:49.961427 7233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551: Bootstrap starting.
I20260812 11:15:49.961782 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:15:49.964704 7233 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:49.965848 7233 log.cc:824] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:49.968961 7240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:49.966179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42911 (local address 127.0.0.1:36543)
0812 11:15:49.966362 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:49.966368 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:49.967038 (+ 670us) server_negotiation.cc:407] Connection header received
0812 11:15:49.967217 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:49.967222 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:49.967286 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:49.967389 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:49.968343 (+ 954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:49.968349 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:49.968354 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:49.968374 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:49.968422 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:49.968443 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:49.968568 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:49.968614 (+ 46us) server_negotiation.cc:299] Negotiation successful
0812 11:15:49.968685 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:15:49.969415 7233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551: No bootstrap required, opened a new log
I20260812 11:15:49.977340 7233 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ff6cc7237e47919207e5215a306551" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36543 } }
I20260812 11:15:49.977780 7233 raft_consensus.cc:374] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:49.977886 7233 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1ff6cc7237e47919207e5215a306551, State: Initialized, Role: FOLLOWER
I20260812 11:15:49.978504 7233 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ff6cc7237e47919207e5215a306551" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36543 } }
I20260812 11:15:49.978737 7233 raft_consensus.cc:388] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:15:49.978876 7233 raft_consensus.cc:482] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:15:49.979024 7233 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:49.981405 7233 raft_consensus.cc:504] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ff6cc7237e47919207e5215a306551" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36543 } }
I20260812 11:15:49.981935 7233 leader_election.cc:302] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1ff6cc7237e47919207e5215a306551; no voters:
I20260812 11:15:49.982631 7233 leader_election.cc:288] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:15:49.982815 7249 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:49.983469 7249 raft_consensus.cc:686] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [term 1 LEADER]: Becoming Leader. State: Replica: c1ff6cc7237e47919207e5215a306551, State: Running, Role: LEADER
I20260812 11:15:49.984149 7249 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ff6cc7237e47919207e5215a306551" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36543 } }
I20260812 11:15:49.985034 7233 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:15:49.987349 7254 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1ff6cc7237e47919207e5215a306551" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ff6cc7237e47919207e5215a306551" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36543 } } }
I20260812 11:15:49.987315 7255 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1ff6cc7237e47919207e5215a306551. Latest consensus state: current_term: 1 leader_uuid: "c1ff6cc7237e47919207e5215a306551" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ff6cc7237e47919207e5215a306551" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36543 } } }
I20260812 11:15:49.987871 7254 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:49.987882 7255 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:49.997889 7259 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:15:50.003675 7259 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:15:50.013410 7259 catalog_manager.cc:1347] Generated new cluster ID: 7dc6ec0106c54cd0a4ff2d37207bb876
I20260812 11:15:50.013545 7259 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:15:50.028441 7259 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:15:50.028987 7259 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:15:50.035599 7259 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c1ff6cc7237e47919207e5215a306551: Generated new TSK 0
I20260812 11:15:50.036784 7259 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:15:50.054234 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 7124
W20260812 11:15:50.055517 7223 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53453
W20260812 11:15:50.056294 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 7124: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:15:50.056442 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 7124
2026-08-12T11:15:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2172 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:15:50 dist-test-slave-rmhg krb5kdc[7287](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:15:50 dist-test-slave-rmhg krb5kdc[7287](info): set up 2 sockets
Aug 12 11:15:50 dist-test-slave-rmhg krb5kdc[7287](info): commencing operation
krb5kdc: starting...
W20260812 11:15:51.343204 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.000s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:15:51 dist-test-slave-rmhg krb5kdc[7287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:15:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:15:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:15:51.682545 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33363
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33363
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:52.044343 7303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:52.044693 7303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:52.044840 7303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:52.052603 7303 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:15:52.052752 7303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:52.052803 7303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:52.052889 7303 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:15:52.052948 7303 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:15:52.063262 7303 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:52.064664 7303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:52.066071 7303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:52.078677 7313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:52.078627 7319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:52.078698 7317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:52.079174 7303 server_base.cc:1034] running on GCE node
I20260812 11:15:52.080251 7303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:52.081888 7303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:52.083124 7303 hybrid_clock.cc:648] HybridClock initialized: now 1786533352083076 us; error 44 us; skew 500 ppm
I20260812 11:15:52.083501 7303 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:52 dist-test-slave-rmhg krb5kdc[7287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533352, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:52.090962 7303 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:15:52.092815 7303 webserver.cc:460] Webserver started at http://127.0.0.1:32997/ using document root <none> and password file <none>
I20260812 11:15:52.093649 7303 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:52.093788 7303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:52.094111 7303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:52.097492 7303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "c5c2a2a0ebbc4095b3c7b4dc9b5f446f"
format_stamp: "Formatted at 2026-08-12 11:15:52 on dist-test-slave-rmhg"
server_key: "43a6eb96bd1e1fe0490e18fd957b309a"
server_key_iv: "a02b2e93a7cbdbd993f3d06816467632"
server_key_version: "encryptionkey@0"
I20260812 11:15:52.098371 7303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "c5c2a2a0ebbc4095b3c7b4dc9b5f446f"
format_stamp: "Formatted at 2026-08-12 11:15:52 on dist-test-slave-rmhg"
server_key: "43a6eb96bd1e1fe0490e18fd957b309a"
server_key_iv: "a02b2e93a7cbdbd993f3d06816467632"
server_key_version: "encryptionkey@0"
I20260812 11:15:52.104236 7303 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260812 11:15:52.108282 7333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:52.109813 7303 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:15:52.110008 7303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "c5c2a2a0ebbc4095b3c7b4dc9b5f446f"
format_stamp: "Formatted at 2026-08-12 11:15:52 on dist-test-slave-rmhg"
server_key: "43a6eb96bd1e1fe0490e18fd957b309a"
server_key_iv: "a02b2e93a7cbdbd993f3d06816467632"
server_key_version: "encryptionkey@0"
I20260812 11:15:52.110224 7303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:52.129472 7303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:52.134020 7303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:52.134322 7303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:52.152729 7303 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33363
I20260812 11:15:52.152751 7421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33363 every 8 connection(s)
I20260812 11:15:52.154284 7303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:15:52.156658 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 7303
I20260812 11:15:52.156863 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:15:52.157531 4201 external_mini_cluster.cc:1428] Setting key 698cc1bc973435ca632432d7bf511ab0
I20260812 11:15:52.158994 7422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 12 11:15:52 dist-test-slave-rmhg krb5kdc[7287](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 11:15:52.173938 7422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f: Bootstrap starting.
I20260812 11:15:52.177515 7422 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:52.178882 7422 log.cc:824] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:52.182382 7422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f: No bootstrap required, opened a new log
I20260812 11:15:52.182732 7429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:52.159479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:56257 (local address 127.0.0.1:33363)
0812 11:15:52.160304 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:52.160316 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:52.160362 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:15:52.162085 (+ 1723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:52.162113 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:52.162584 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:52.162961 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:52.164929 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:52.166480 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:52.168344 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:52.169129 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:52.169359 (+ 230us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:52.174565 (+ 5206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:52.174576 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:52.174594 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:52.174651 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:52.177877 (+ 3226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:52.178958 (+ 1081us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:52.178966 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:52.178977 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:52.179201 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:52.179752 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:52.179761 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:52.179765 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:52.180480 (+ 715us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:52.180718 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:52.181276 (+ 558us) server_negotiation.cc:299] Negotiation successful
0812 11:15:52.181646 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":338,"threads_started":1}
I20260812 11:15:52.187091 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:15:52.192242 7422 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5c2a2a0ebbc4095b3c7b4dc9b5f446f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33363 } }
I20260812 11:15:52.192801 7422 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:52.192914 7422 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5c2a2a0ebbc4095b3c7b4dc9b5f446f, State: Initialized, Role: FOLLOWER
I20260812 11:15:52.193869 7422 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5c2a2a0ebbc4095b3c7b4dc9b5f446f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33363 } }
I20260812 11:15:52.194149 7422 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:15:52.194293 7422 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:15:52.194476 7422 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:52.197449 7422 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5c2a2a0ebbc4095b3c7b4dc9b5f446f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33363 } }
I20260812 11:15:52.198076 7422 leader_election.cc:302] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5c2a2a0ebbc4095b3c7b4dc9b5f446f; no voters:
I20260812 11:15:52.198945 7422 leader_election.cc:288] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:15:52.199105 7440 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:52.201439 7440 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [term 1 LEADER]: Becoming Leader. State: Replica: c5c2a2a0ebbc4095b3c7b4dc9b5f446f, State: Running, Role: LEADER
I20260812 11:15:52.201592 7422 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:15:52.202188 7440 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5c2a2a0ebbc4095b3c7b4dc9b5f446f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33363 } }
I20260812 11:15:52.206593 7445 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5c2a2a0ebbc4095b3c7b4dc9b5f446f. Latest consensus state: current_term: 1 leader_uuid: "c5c2a2a0ebbc4095b3c7b4dc9b5f446f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5c2a2a0ebbc4095b3c7b4dc9b5f446f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33363 } } }
I20260812 11:15:52.207131 7445 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:52.207134 7441 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5c2a2a0ebbc4095b3c7b4dc9b5f446f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5c2a2a0ebbc4095b3c7b4dc9b5f446f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33363 } } }
I20260812 11:15:52.207521 7441 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:52.211889 7429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:52.192564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:59239 (local address 127.0.0.1:33363)
0812 11:15:52.192778 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:52.192789 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:52.193292 (+ 503us) server_negotiation.cc:407] Connection header received
0812 11:15:52.193483 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:52.193489 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:52.193581 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:52.193708 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:52.195304 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:52.196472 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:52.197845 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:52.198530 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:52.198700 (+ 170us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:52.202134 (+ 3434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:52.202142 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:52.202147 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:52.202205 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:52.206639 (+ 4434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:52.208959 (+ 2320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:52.208968 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:52.208982 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:52.209342 (+ 360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:52.209956 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:52.209962 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:52.209966 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:52.210428 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:52.210796 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:52.211171 (+ 375us) server_negotiation.cc:299] Negotiation successful
0812 11:15:52.211409 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260812 11:15:52.214504 7454 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:15:52.219875 7454 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:15:52.229591 7454 catalog_manager.cc:1347] Generated new cluster ID: 933db70c6c214098ae7e07122b7a6666
I20260812 11:15:52.229736 7454 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:15:52.249446 7454 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:15:52.251633 7454 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:15:52.263352 7454 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5c2a2a0ebbc4095b3c7b4dc9b5f446f: Generated new TSK 0
I20260812 11:15:52.264369 7454 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:15:52.275516 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 7303
I20260812 11:15:52.276891 7415 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:52.370990 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 7303
W20260812 11:15:52.397297 7285 connection.cc:535] client connection to 127.0.0.1:33363 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33363): Connection reset by peer (error 104)
2026-08-12T11:15:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2313 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:15:52 dist-test-slave-rmhg krb5kdc[7473](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:15:52 dist-test-slave-rmhg krb5kdc[7473](info): set up 2 sockets
Aug 12 11:15:52 dist-test-slave-rmhg krb5kdc[7473](info): commencing operation
krb5kdc: starting...
W20260812 11:15:53.664796 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.248s user 0.010s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:15:53 dist-test-slave-rmhg krb5kdc[7473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:15:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:15:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:15:54.007822 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46097
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46097
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:54.366822 7498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:54.367157 7498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:54.367283 7498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:54.374769 7498 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:15:54.374913 7498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:54.374969 7498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:54.375063 7498 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:15:54.375108 7498 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:15:54.387354 7498 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46097
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:54.388796 7498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:54.390210 7498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:54.402184 7507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:54.402382 7506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:54.402496 7514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:54.403249 7498 server_base.cc:1034] running on GCE node
I20260812 11:15:54.404206 7498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:54.405845 7498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:54.407083 7498 hybrid_clock.cc:648] HybridClock initialized: now 1786533354407030 us; error 44 us; skew 500 ppm
I20260812 11:15:54.407456 7498 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:54 dist-test-slave-rmhg krb5kdc[7473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533354, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:54.410795 7498 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:15:54.412386 7498 webserver.cc:460] Webserver started at http://127.0.0.1:36129/ using document root <none> and password file <none>
I20260812 11:15:54.413096 7498 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:54.413259 7498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:54.413564 7498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:54.416639 7498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "0d1c8a8758db4fffa3e40969e65c123d"
format_stamp: "Formatted at 2026-08-12 11:15:54 on dist-test-slave-rmhg"
server_key: "905ac2a8b9f1b33c9b2f3dfbe08a9af0"
server_key_iv: "ee929784d717969100eec01f9e67ec93"
server_key_version: "encryptionkey@0"
I20260812 11:15:54.417441 7498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "0d1c8a8758db4fffa3e40969e65c123d"
format_stamp: "Formatted at 2026-08-12 11:15:54 on dist-test-slave-rmhg"
server_key: "905ac2a8b9f1b33c9b2f3dfbe08a9af0"
server_key_iv: "ee929784d717969100eec01f9e67ec93"
server_key_version: "encryptionkey@0"
I20260812 11:15:54.422757 7498 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260812 11:15:54.426311 7524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:54.427712 7498 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:15:54.427863 7498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "0d1c8a8758db4fffa3e40969e65c123d"
format_stamp: "Formatted at 2026-08-12 11:15:54 on dist-test-slave-rmhg"
server_key: "905ac2a8b9f1b33c9b2f3dfbe08a9af0"
server_key_iv: "ee929784d717969100eec01f9e67ec93"
server_key_version: "encryptionkey@0"
I20260812 11:15:54.428036 7498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:54.443420 7498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:54.447707 7498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:54.447958 7498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:54.466373 7498 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46097
I20260812 11:15:54.466413 7624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46097 every 8 connection(s)
I20260812 11:15:54.467859 7498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:15:54.472047 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 7498
I20260812 11:15:54.472256 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:15:54.472328 7627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:54.472831 4201 external_mini_cluster.cc:1428] Setting key ba70e88293db9916b10517d1caa0b0da
I20260812 11:15:54.487206 7630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:54.474816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:55975 (local address 127.0.0.1:46097)
0812 11:15:54.475687 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:54.475700 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:54.475750 (+ 50us) server_negotiation.cc:407] Connection header received
0812 11:15:54.477490 (+ 1740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:54.477518 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:54.477982 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:54.478375 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:54.479084 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:54.480532 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:54.482410 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:54.483144 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:54.483293 (+ 149us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:54.484684 (+ 1391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:54.484693 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:54.484710 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:54.485345 (+ 635us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:54.485437 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:54.485463 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:54.485584 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:54.485949 (+ 365us) server_negotiation.cc:299] Negotiation successful
0812 11:15:54.486185 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":374,"threads_started":1}
I20260812 11:15:54.487351 7627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d: Bootstrap starting.
I20260812 11:15:54.490877 7627 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:54.491353 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:15:54.492146 7627 log.cc:824] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:54.495818 7627 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d: No bootstrap required, opened a new log
I20260812 11:15:54.504006 7630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:54.497024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:36109 (local address 127.0.0.1:46097)
0812 11:15:54.497236 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:54.497242 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:54.497640 (+ 398us) server_negotiation.cc:407] Connection header received
0812 11:15:54.497798 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:54.497803 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:54.497892 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:54.498004 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:54.498503 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:54.499702 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:54.501135 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:54.501858 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:54.501996 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:54.503180 (+ 1184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:54.503190 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:54.503195 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:54.503218 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:54.503287 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:54.503308 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:54.503429 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:54.503600 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 11:15:54.503657 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260812 11:15:54.505775 7627 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d1c8a8758db4fffa3e40969e65c123d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46097 } }
I20260812 11:15:54.506160 7627 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:54.506240 7627 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1c8a8758db4fffa3e40969e65c123d, State: Initialized, Role: FOLLOWER
I20260812 11:15:54.506805 7627 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d1c8a8758db4fffa3e40969e65c123d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46097 } }
I20260812 11:15:54.507035 7627 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:15:54.507140 7627 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:15:54.507267 7627 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:54.509505 7627 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d1c8a8758db4fffa3e40969e65c123d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46097 } }
I20260812 11:15:54.510007 7627 leader_election.cc:302] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0d1c8a8758db4fffa3e40969e65c123d; no voters:
I20260812 11:15:54.510685 7627 leader_election.cc:288] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:15:54.510810 7639 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:54.511754 7639 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [term 1 LEADER]: Becoming Leader. State: Replica: 0d1c8a8758db4fffa3e40969e65c123d, State: Running, Role: LEADER
I20260812 11:15:54.512281 7639 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d1c8a8758db4fffa3e40969e65c123d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46097 } }
I20260812 11:15:54.512854 7627 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:15:54.515237 7644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d1c8a8758db4fffa3e40969e65c123d. Latest consensus state: current_term: 1 leader_uuid: "0d1c8a8758db4fffa3e40969e65c123d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d1c8a8758db4fffa3e40969e65c123d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46097 } } }
I20260812 11:15:54.515664 7644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:54.516237 7642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0d1c8a8758db4fffa3e40969e65c123d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d1c8a8758db4fffa3e40969e65c123d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46097 } } }
I20260812 11:15:54.516563 7642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:54.517396 7651 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:15:54.523416 7651 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:15:54.532255 7651 catalog_manager.cc:1347] Generated new cluster ID: 2d132a84335044f69dc6a156f06ef69e
I20260812 11:15:54.532486 7651 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:15:54.547349 7651 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:15:54.548689 7651 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:15:54.560007 7651 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0d1c8a8758db4fffa3e40969e65c123d: Generated new TSK 0
I20260812 11:15:54.561067 7651 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:15:54.578634 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 7498
W20260812 11:15:54.579977 7620 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.204:55975
W20260812 11:15:54.580862 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 7498: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:15:54.581069 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 7498
W20260812 11:15:54.609170 7471 connection.cc:535] client connection to 127.0.0.1:46097 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46097): Connection reset by peer (error 104)
2026-08-12T11:15:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2211 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:15:54 dist-test-slave-rmhg krb5kdc[7671](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:15:54 dist-test-slave-rmhg krb5kdc[7671](info): set up 2 sockets
Aug 12 11:15:54 dist-test-slave-rmhg krb5kdc[7671](info): commencing operation
krb5kdc: starting...
W20260812 11:15:55.868183 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.007s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:15:56 dist-test-slave-rmhg krb5kdc[7671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:15:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:15:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:15:56.205122 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34877
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34877
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:56.562426 7696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:56.562747 7696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:56.562870 7696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:56.570619 7696 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:15:56.570756 7696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:56.570808 7696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:56.570902 7696 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:15:56.570963 7696 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:15:56.581367 7696 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34877
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:56.582839 7696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:56.584709 7696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:56.597276 7705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:56.597184 7709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:56.597254 7706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:56.597996 7696 server_base.cc:1034] running on GCE node
I20260812 11:15:56.598882 7696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:56.600474 7696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:56.601723 7696 hybrid_clock.cc:648] HybridClock initialized: now 1786533356601665 us; error 51 us; skew 500 ppm
I20260812 11:15:56.602113 7696 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:56 dist-test-slave-rmhg krb5kdc[7671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533356, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:56.605489 7696 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:15:56.607200 7696 webserver.cc:460] Webserver started at http://127.0.0.1:43129/ using document root <none> and password file <none>
I20260812 11:15:56.608040 7696 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:56.608172 7696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:56.608497 7696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:56.611717 7696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "5c92ef28a2c548e992baffe7659ab29c"
format_stamp: "Formatted at 2026-08-12 11:15:56 on dist-test-slave-rmhg"
server_key: "48d38e1d9f0fffde7d40551a8c871edf"
server_key_iv: "4443dc2701dfa78ade5b4e66167e9fa3"
server_key_version: "encryptionkey@0"
I20260812 11:15:56.612510 7696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "5c92ef28a2c548e992baffe7659ab29c"
format_stamp: "Formatted at 2026-08-12 11:15:56 on dist-test-slave-rmhg"
server_key: "48d38e1d9f0fffde7d40551a8c871edf"
server_key_iv: "4443dc2701dfa78ade5b4e66167e9fa3"
server_key_version: "encryptionkey@0"
I20260812 11:15:56.618005 7696 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:15:56.621773 7726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:56.623312 7696 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260812 11:15:56.623512 7696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "5c92ef28a2c548e992baffe7659ab29c"
format_stamp: "Formatted at 2026-08-12 11:15:56 on dist-test-slave-rmhg"
server_key: "48d38e1d9f0fffde7d40551a8c871edf"
server_key_iv: "4443dc2701dfa78ade5b4e66167e9fa3"
server_key_version: "encryptionkey@0"
I20260812 11:15:56.623720 7696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:56.629868 7696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:56.634086 7696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:56.634375 7696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:56.652312 7696 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34877
I20260812 11:15:56.652361 7823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34877 every 8 connection(s)
I20260812 11:15:56.653820 7696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:15:56.657765 7824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:56.659067 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 7696
I20260812 11:15:56.659274 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:15:56.659837 4201 external_mini_cluster.cc:1428] Setting key 62f9a437b525d5f4576a7f30a6ad34f5
I20260812 11:15:56.667958 7829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:56.661911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:58657 (local address 127.0.0.1:34877)
0812 11:15:56.662748 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:56.662760 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:56.662807 (+ 47us) server_negotiation.cc:407] Connection header received
0812 11:15:56.664467 (+ 1660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:56.664493 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:56.664870 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:56.665284 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:56.666323 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:56.666330 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:56.666343 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:56.666358 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:56.666421 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:56.666445 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:56.666674 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:56.666806 (+ 132us) server_negotiation.cc:299] Negotiation successful
0812 11:15:56.667006 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":320,"threads_started":1}
I20260812 11:15:56.671916 7824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c: Bootstrap starting.
I20260812 11:15:56.672106 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:15:56.675207 7824 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:56.676287 7824 log.cc:824] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:56.679068 7829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:56.676582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:55649 (local address 127.0.0.1:34877)
0812 11:15:56.676792 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:56.676800 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:56.677220 (+ 420us) server_negotiation.cc:407] Connection header received
0812 11:15:56.677399 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:56.677404 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:56.677476 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:56.677605 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:56.678471 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:56.678475 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:56.678478 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:15:56.678493 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:56.678530 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:15:56.678544 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:56.678657 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:56.678763 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 11:15:56.678813 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260812 11:15:56.679849 7824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c: No bootstrap required, opened a new log
I20260812 11:15:56.687709 7824 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c92ef28a2c548e992baffe7659ab29c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34877 } }
I20260812 11:15:56.688124 7824 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:56.688241 7824 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c92ef28a2c548e992baffe7659ab29c, State: Initialized, Role: FOLLOWER
I20260812 11:15:56.688974 7824 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c92ef28a2c548e992baffe7659ab29c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34877 } }
I20260812 11:15:56.689277 7824 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:15:56.689392 7824 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:15:56.689523 7824 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:56.691692 7824 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c92ef28a2c548e992baffe7659ab29c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34877 } }
I20260812 11:15:56.692214 7824 leader_election.cc:302] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c92ef28a2c548e992baffe7659ab29c; no voters:
I20260812 11:15:56.692795 7824 leader_election.cc:288] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:15:56.692945 7837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:56.694008 7837 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [term 1 LEADER]: Becoming Leader. State: Replica: 5c92ef28a2c548e992baffe7659ab29c, State: Running, Role: LEADER
I20260812 11:15:56.694623 7837 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c92ef28a2c548e992baffe7659ab29c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34877 } }
I20260812 11:15:56.694957 7824 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:15:56.697510 7839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c92ef28a2c548e992baffe7659ab29c. Latest consensus state: current_term: 1 leader_uuid: "5c92ef28a2c548e992baffe7659ab29c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c92ef28a2c548e992baffe7659ab29c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34877 } } }
I20260812 11:15:56.697988 7839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:56.698493 7838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c92ef28a2c548e992baffe7659ab29c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c92ef28a2c548e992baffe7659ab29c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34877 } } }
I20260812 11:15:56.698807 7838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:56.699036 7850 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:15:56.705797 7850 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:15:56.716123 7850 catalog_manager.cc:1347] Generated new cluster ID: b9029877a63d4376a37e33742af2fcf3
I20260812 11:15:56.716245 7850 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:15:56.744557 7850 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:15:56.745187 7850 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:15:56.763170 7850 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5c92ef28a2c548e992baffe7659ab29c: Generated new TSK 0
I20260812 11:15:56.764422 7850 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:15:56.770603 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 7696
W20260812 11:15:56.771834 7818 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.204:58657
W20260812 11:15:56.772549 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 7696: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:15:56.772727 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 7696
2026-08-12T11:15:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2192 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:15:56 dist-test-slave-rmhg krb5kdc[7869](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:15:56 dist-test-slave-rmhg krb5kdc[7869](info): set up 2 sockets
Aug 12 11:15:56 dist-test-slave-rmhg krb5kdc[7869](info): commencing operation
krb5kdc: starting...
W20260812 11:15:58.082270 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.261s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:15:58 dist-test-slave-rmhg krb5kdc[7869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533358, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:15:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:15:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:15:58.418612 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43685
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43685
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:15:58.779451 7890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:15:58.779826 7890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:15:58.779975 7890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:15:58.787628 7890 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:15:58.787796 7890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:15:58.787873 7890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:15:58.787963 7890 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:15:58.788024 7890 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:15:58.798985 7890 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43685
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:15:58.800482 7890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:15:58.801992 7890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:15:58.815383 7900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:58.815295 7902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:15:58.815333 7898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:15:58.819126 7890 server_base.cc:1034] running on GCE node
I20260812 11:15:58.820145 7890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:15:58.821878 7890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:15:58.823148 7890 hybrid_clock.cc:648] HybridClock initialized: now 1786533358823101 us; error 46 us; skew 500 ppm
I20260812 11:15:58.823621 7890 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:15:58 dist-test-slave-rmhg krb5kdc[7869](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533358, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:15:58.832688 7890 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:15:58.834623 7890 webserver.cc:460] Webserver started at http://127.0.0.1:38987/ using document root <none> and password file <none>
I20260812 11:15:58.835459 7890 fs_manager.cc:359] Metadata directory not provided
I20260812 11:15:58.835616 7890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:15:58.835942 7890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:15:58.839334 7890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "169f59cc9aeb45c98c52402aa40f8f41"
format_stamp: "Formatted at 2026-08-12 11:15:58 on dist-test-slave-rmhg"
server_key: "6561d0c6bd66a4f25ace950976375f87"
server_key_iv: "45e1f26c118436546d19a18f0003f89f"
server_key_version: "encryptionkey@0"
I20260812 11:15:58.840402 7890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "169f59cc9aeb45c98c52402aa40f8f41"
format_stamp: "Formatted at 2026-08-12 11:15:58 on dist-test-slave-rmhg"
server_key: "6561d0c6bd66a4f25ace950976375f87"
server_key_iv: "45e1f26c118436546d19a18f0003f89f"
server_key_version: "encryptionkey@0"
I20260812 11:15:58.846290 7890 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:15:58.850313 7914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:15:58.851884 7890 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260812 11:15:58.852085 7890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "169f59cc9aeb45c98c52402aa40f8f41"
format_stamp: "Formatted at 2026-08-12 11:15:58 on dist-test-slave-rmhg"
server_key: "6561d0c6bd66a4f25ace950976375f87"
server_key_iv: "45e1f26c118436546d19a18f0003f89f"
server_key_version: "encryptionkey@0"
I20260812 11:15:58.852320 7890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:15:58.878947 7890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:15:58.884171 7890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:15:58.884502 7890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:15:58.903501 7890 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43685
I20260812 11:15:58.903560 7998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43685 every 8 connection(s)
I20260812 11:15:58.905004 7890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:15:58.909035 7999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:15:58.914733 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 7890
I20260812 11:15:58.914914 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:15:58.915381 4201 external_mini_cluster.cc:1428] Setting key 4f4bfaec974c8ed870e4bf235c1d75ad
I20260812 11:15:58.920625 7999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41: Bootstrap starting.
I20260812 11:15:58.924005 7999 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41: Neither blocks nor log segments found. Creating new log.
I20260812 11:15:58.925127 7999 log.cc:824] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41: Log is configured to *not* fsync() on all Append() calls
I20260812 11:15:58.928375 7999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41: No bootstrap required, opened a new log
Aug 12 11:15:58 dist-test-slave-rmhg krb5kdc[7869](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533358, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260812 11:15:58.936697 7999 raft_consensus.cc:348] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "169f59cc9aeb45c98c52402aa40f8f41" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43685 } }
I20260812 11:15:58.937127 7999 raft_consensus.cc:374] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:15:58.937273 7999 raft_consensus.cc:729] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169f59cc9aeb45c98c52402aa40f8f41, State: Initialized, Role: FOLLOWER
I20260812 11:15:58.937909 7999 consensus_queue.cc:260] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "169f59cc9aeb45c98c52402aa40f8f41" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43685 } }
I20260812 11:15:58.938148 7999 raft_consensus.cc:388] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:15:58.938294 7999 raft_consensus.cc:482] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:15:58.938476 7999 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:15:58.938524 8007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:58.917290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:54797 (local address 127.0.0.1:43685)
0812 11:15:58.918189 (+ 899us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:58.918205 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:58.918256 (+ 51us) server_negotiation.cc:407] Connection header received
0812 11:15:58.919991 (+ 1735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:58.920020 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:58.920486 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:58.920867 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:58.922448 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:58.923781 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:58.925213 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:58.925984 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:58.926182 (+ 198us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:58.930525 (+ 4343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:58.930537 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:58.930557 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:58.930602 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:58.933934 (+ 3332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:58.934797 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:58.934805 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:58.934813 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:58.935011 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:58.935501 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:58.935504 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:58.935507 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:58.936089 (+ 582us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:58.936384 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:58.936899 (+ 515us) server_negotiation.cc:299] Negotiation successful
0812 11:15:58.937347 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":402,"threads_started":1}
I20260812 11:15:58.941438 7999 raft_consensus.cc:504] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "169f59cc9aeb45c98c52402aa40f8f41" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43685 } }
I20260812 11:15:58.942054 7999 leader_election.cc:302] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 169f59cc9aeb45c98c52402aa40f8f41; no voters:
I20260812 11:15:58.942770 7999 leader_election.cc:288] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:15:58.942925 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:15:58.942917 8013 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:15:58.945066 7999 sys_catalog.cc:564] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:15:58.954757 8013 raft_consensus.cc:686] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [term 1 LEADER]: Becoming Leader. State: Replica: 169f59cc9aeb45c98c52402aa40f8f41, State: Running, Role: LEADER
I20260812 11:15:58.955648 8013 consensus_queue.cc:237] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "169f59cc9aeb45c98c52402aa40f8f41" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43685 } }
I20260812 11:15:58.960951 8016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "169f59cc9aeb45c98c52402aa40f8f41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "169f59cc9aeb45c98c52402aa40f8f41" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43685 } } }
I20260812 11:15:58.961453 8016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [sys.catalog]: This master's current role is: LEADER
I20260812 11:15:58.960922 8017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 169f59cc9aeb45c98c52402aa40f8f41. Latest consensus state: current_term: 1 leader_uuid: "169f59cc9aeb45c98c52402aa40f8f41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "169f59cc9aeb45c98c52402aa40f8f41" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43685 } } }
I20260812 11:15:58.962143 8017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41 [sys.catalog]: This master's current role is: LEADER
W20260812 11:15:58.968464 8045 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:15:58.968652 8045 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:15:58.968909 8044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:15:58.971464 8044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:15:58.976411 8007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:15:58.954636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:47063 (local address 127.0.0.1:43685)
0812 11:15:58.954831 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0812 11:15:58.954839 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:15:58.959124 (+ 4285us) server_negotiation.cc:407] Connection header received
0812 11:15:58.959339 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:15:58.959347 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:15:58.959448 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:15:58.959564 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:15:58.961961 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:58.963204 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:58.964720 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:15:58.965207 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:15:58.965341 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:15:58.968095 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:15:58.968101 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:15:58.968105 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:15:58.968148 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:15:58.972343 (+ 4195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:58.973639 (+ 1296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:58.973646 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:58.973649 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:58.973822 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:15:58.974475 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:15:58.974480 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:15:58.974487 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:15:58.974977 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:15:58.975257 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0812 11:15:58.975841 (+ 584us) server_negotiation.cc:299] Negotiation successful
0812 11:15:58.976052 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260812 11:15:58.981318 8044 catalog_manager.cc:1347] Generated new cluster ID: 6b09b7c3ca484fb9801d1250afe297e4
I20260812 11:15:58.981451 8044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:15:58.992863 8044 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:15:58.994807 8044 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:15:59.008392 8044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 169f59cc9aeb45c98c52402aa40f8f41: Generated new TSK 0
I20260812 11:15:59.009588 8044 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:15:59.021353 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 7890
I20260812 11:15:59.023108 7993 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:15:59.116323 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 7890
W20260812 11:15:59.140841 7867 connection.cc:535] client connection to 127.0.0.1:43685 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43685): Connection reset by peer (error 104)
2026-08-12T11:15:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2343 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:15:59 dist-test-slave-rmhg krb5kdc[8060](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:15:59 dist-test-slave-rmhg krb5kdc[8060](info): set up 2 sockets
Aug 12 11:15:59 dist-test-slave-rmhg krb5kdc[8060](info): commencing operation
krb5kdc: starting...
W20260812 11:16:00.406996 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.003s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:16:00 dist-test-slave-rmhg krb5kdc[8060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:16:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:16:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:16:00.748098 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46569
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46569
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:01.102232 8078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:01.102561 8078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:01.102666 8078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:01.110108 8078 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:01.110239 8078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:01.110287 8078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:01.110353 8078 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:01.110396 8078 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:01.120633 8078 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46569
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:01.122036 8078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:01.123327 8078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:01.135710 8088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:01.135746 8085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:01.135777 8083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:01.136703 8078 server_base.cc:1034] running on GCE node
I20260812 11:16:01.137698 8078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:01.139297 8078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:01.140538 8078 hybrid_clock.cc:648] HybridClock initialized: now 1786533361140477 us; error 49 us; skew 500 ppm
I20260812 11:16:01.140918 8078 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:01 dist-test-slave-rmhg krb5kdc[8060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533361, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:01.144326 8078 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:16:01.145965 8078 webserver.cc:460] Webserver started at http://127.0.0.1:43221/ using document root <none> and password file <none>
I20260812 11:16:01.146662 8078 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:01.146772 8078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:01.147033 8078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:01.150315 8078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "387cc2d71c524ec0bb1b5351f94fb6f3"
format_stamp: "Formatted at 2026-08-12 11:16:01 on dist-test-slave-rmhg"
server_key: "01d76c520c69b41bac90cc4f8d89b82e"
server_key_iv: "7c4259f4070496845459ddc3103413f0"
server_key_version: "encryptionkey@0"
I20260812 11:16:01.151206 8078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "387cc2d71c524ec0bb1b5351f94fb6f3"
format_stamp: "Formatted at 2026-08-12 11:16:01 on dist-test-slave-rmhg"
server_key: "01d76c520c69b41bac90cc4f8d89b82e"
server_key_iv: "7c4259f4070496845459ddc3103413f0"
server_key_version: "encryptionkey@0"
I20260812 11:16:01.157084 8078 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260812 11:16:01.161070 8099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:01.162668 8078 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:16:01.162855 8078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "387cc2d71c524ec0bb1b5351f94fb6f3"
format_stamp: "Formatted at 2026-08-12 11:16:01 on dist-test-slave-rmhg"
server_key: "01d76c520c69b41bac90cc4f8d89b82e"
server_key_iv: "7c4259f4070496845459ddc3103413f0"
server_key_version: "encryptionkey@0"
I20260812 11:16:01.163048 8078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:01.195245 8078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:01.200094 8078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:01.200383 8078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:01.219439 8078 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46569
I20260812 11:16:01.219468 8194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46569 every 8 connection(s)
I20260812 11:16:01.221081 8078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:16:01.222332 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 8078
I20260812 11:16:01.222520 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:16:01.222993 4201 external_mini_cluster.cc:1428] Setting key 2bfd467826439e3186bae665a7a39204
I20260812 11:16:01.226116 8197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:01.236948 8206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:01.225078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:56385 (local address 127.0.0.1:46569)
0812 11:16:01.225986 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:01.226001 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:01.226047 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:16:01.227762 (+ 1715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:01.227788 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:01.228209 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:01.228612 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:01.229254 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:01.230662 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:01.232056 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:01.232788 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:01.232981 (+ 193us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:01.234366 (+ 1385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:01.234374 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:01.234392 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:16:01.235055 (+ 663us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:01.235146 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:16:01.235179 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:01.235363 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:01.235686 (+ 323us) server_negotiation.cc:299] Negotiation successful
0812 11:16:01.235872 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":665,"thread_start_us":368,"threads_started":1}
I20260812 11:16:01.237627 8197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3: Bootstrap starting.
I20260812 11:16:01.241631 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:16:01.241779 8197 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:01.242904 8197 log.cc:824] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:01.246624 8197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3: No bootstrap required, opened a new log
I20260812 11:16:01.253242 8206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:01.246334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:47739 (local address 127.0.0.1:46569)
0812 11:16:01.246489 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:01.246493 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:01.247018 (+ 525us) server_negotiation.cc:407] Connection header received
0812 11:16:01.247236 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:01.247244 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:01.247309 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:01.247409 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:01.247980 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:01.248813 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:01.250289 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:01.250785 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:01.250921 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:01.252251 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:01.252259 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:01.252262 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:16:01.252286 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:01.252329 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:16:01.252345 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:01.252464 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:01.252703 (+ 239us) server_negotiation.cc:299] Negotiation successful
0812 11:16:01.252765 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260812 11:16:01.255344 8197 raft_consensus.cc:348] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "387cc2d71c524ec0bb1b5351f94fb6f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46569 } }
I20260812 11:16:01.255740 8197 raft_consensus.cc:374] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:01.255846 8197 raft_consensus.cc:729] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387cc2d71c524ec0bb1b5351f94fb6f3, State: Initialized, Role: FOLLOWER
I20260812 11:16:01.256449 8197 consensus_queue.cc:260] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "387cc2d71c524ec0bb1b5351f94fb6f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46569 } }
I20260812 11:16:01.256683 8197 raft_consensus.cc:388] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:16:01.256825 8197 raft_consensus.cc:482] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:16:01.256999 8197 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:01.259312 8197 raft_consensus.cc:504] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "387cc2d71c524ec0bb1b5351f94fb6f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46569 } }
I20260812 11:16:01.259884 8197 leader_election.cc:302] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 387cc2d71c524ec0bb1b5351f94fb6f3; no voters:
I20260812 11:16:01.260512 8197 leader_election.cc:288] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:16:01.260641 8216 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:01.261934 8216 raft_consensus.cc:686] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [term 1 LEADER]: Becoming Leader. State: Replica: 387cc2d71c524ec0bb1b5351f94fb6f3, State: Running, Role: LEADER
I20260812 11:16:01.262506 8216 consensus_queue.cc:237] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "387cc2d71c524ec0bb1b5351f94fb6f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46569 } }
I20260812 11:16:01.262909 8197 sys_catalog.cc:564] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:16:01.265556 8218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "387cc2d71c524ec0bb1b5351f94fb6f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "387cc2d71c524ec0bb1b5351f94fb6f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46569 } } }
I20260812 11:16:01.265564 8220 sys_catalog.cc:455] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 387cc2d71c524ec0bb1b5351f94fb6f3. Latest consensus state: current_term: 1 leader_uuid: "387cc2d71c524ec0bb1b5351f94fb6f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "387cc2d71c524ec0bb1b5351f94fb6f3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46569 } } }
I20260812 11:16:01.266137 8218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:01.266129 8220 sys_catalog.cc:458] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3 [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:01.268221 8228 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:16:01.275643 8228 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:16:01.285749 8228 catalog_manager.cc:1347] Generated new cluster ID: 0d01890c3cc245daa426ce15611ac321
I20260812 11:16:01.285888 8228 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:16:01.308115 8228 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:16:01.310063 8228 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:16:01.316939 8228 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 387cc2d71c524ec0bb1b5351f94fb6f3: Generated new TSK 0
I20260812 11:16:01.317911 8228 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:16:01.327414 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 8078
W20260812 11:16:01.328747 8188 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.204:56385
W20260812 11:16:01.329685 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 8078: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:16:01.329847 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 8078
W20260812 11:16:01.364943 8055 connection.cc:535] client connection to 127.0.0.1:46569 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46569): Connection reset by peer (error 104)
2026-08-12T11:16:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2220 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:16:01 dist-test-slave-rmhg krb5kdc[8250](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:16:01 dist-test-slave-rmhg krb5kdc[8250](info): set up 2 sockets
Aug 12 11:16:01 dist-test-slave-rmhg krb5kdc[8250](info): commencing operation
krb5kdc: starting...
W20260812 11:16:02.635936 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.251s user 0.003s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:16:02 dist-test-slave-rmhg krb5kdc[8250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:16:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:16:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260812 11:16:02.974172 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38607
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38607
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:03.326941 8268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:03.327297 8268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:03.327435 8268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:03.334993 8268 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:03.335150 8268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:03.335234 8268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:03.335321 8268 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:03.335383 8268 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:03.345736 8268 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38607
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:03.347177 8268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:03.348538 8268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:03.361078 8274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:03.361052 8275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:03.361104 8277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:03.361949 8268 server_base.cc:1034] running on GCE node
I20260812 11:16:03.362833 8268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:03.364519 8268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:03.365759 8268 hybrid_clock.cc:648] HybridClock initialized: now 1786533363365705 us; error 57 us; skew 500 ppm
I20260812 11:16:03.366144 8268 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:03 dist-test-slave-rmhg krb5kdc[8250](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533363, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:03.369586 8268 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260812 11:16:03.371323 8268 webserver.cc:460] Webserver started at http://127.0.0.1:33451/ using document root <none> and password file <none>
I20260812 11:16:03.372049 8268 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:03.372181 8268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:03.372488 8268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:03.375756 8268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "5796ff84a42444dca1e01e38a34b8156"
format_stamp: "Formatted at 2026-08-12 11:16:03 on dist-test-slave-rmhg"
server_key: "f132b3c93b477c9702ec6c5b022760fa"
server_key_iv: "9e9403537ab18b30b2fbcf113b3aaec6"
server_key_version: "encryptionkey@0"
I20260812 11:16:03.376579 8268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "5796ff84a42444dca1e01e38a34b8156"
format_stamp: "Formatted at 2026-08-12 11:16:03 on dist-test-slave-rmhg"
server_key: "f132b3c93b477c9702ec6c5b022760fa"
server_key_iv: "9e9403537ab18b30b2fbcf113b3aaec6"
server_key_version: "encryptionkey@0"
I20260812 11:16:03.382309 8268 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:16:03.386163 8291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:03.387665 8268 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:16:03.387871 8268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "5796ff84a42444dca1e01e38a34b8156"
format_stamp: "Formatted at 2026-08-12 11:16:03 on dist-test-slave-rmhg"
server_key: "f132b3c93b477c9702ec6c5b022760fa"
server_key_iv: "9e9403537ab18b30b2fbcf113b3aaec6"
server_key_version: "encryptionkey@0"
I20260812 11:16:03.388072 8268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:03.394117 8268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:03.398476 8268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:03.398778 8268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:03.416805 8268 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38607
I20260812 11:16:03.416944 8374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38607 every 8 connection(s)
I20260812 11:16:03.418321 8268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:16:03.422453 8377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:03.427461 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 8268
I20260812 11:16:03.427673 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:16:03.428257 4201 external_mini_cluster.cc:1428] Setting key db1899e3116d56bd28c64671280d4ad0
I20260812 11:16:03.434836 8377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156: Bootstrap starting.
I20260812 11:16:03.436805 8381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:03.430244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:49485 (local address 127.0.0.1:38607)
0812 11:16:03.431069 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:03.431082 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:03.431128 (+ 46us) server_negotiation.cc:407] Connection header received
0812 11:16:03.433095 (+ 1967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:03.433124 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:03.433578 (+ 454us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:03.433959 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:03.435110 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:03.435117 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:03.435131 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:16:03.435148 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:03.435225 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:16:03.435247 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:03.435448 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:03.435552 (+ 104us) server_negotiation.cc:299] Negotiation successful
0812 11:16:03.435782 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":355,"threads_started":1}
I20260812 11:16:03.438437 8377 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:03.439656 8377 log.cc:824] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:03.440909 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:16:03.443009 8377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156: No bootstrap required, opened a new log
I20260812 11:16:03.448262 8381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:03.445488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.204:60029 (local address 127.0.0.1:38607)
0812 11:16:03.445659 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:03.445665 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:03.446188 (+ 523us) server_negotiation.cc:407] Connection header received
0812 11:16:03.446393 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:03.446397 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:03.446452 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:03.446550 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:03.447531 (+ 981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:03.447541 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:03.447546 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:16:03.447565 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:03.447610 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:16:03.447629 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:03.447757 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:03.447859 (+ 102us) server_negotiation.cc:299] Negotiation successful
0812 11:16:03.447931 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:16:03.452102 8377 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5796ff84a42444dca1e01e38a34b8156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38607 } }
I20260812 11:16:03.452528 8377 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:03.452632 8377 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5796ff84a42444dca1e01e38a34b8156, State: Initialized, Role: FOLLOWER
I20260812 11:16:03.453250 8377 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5796ff84a42444dca1e01e38a34b8156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38607 } }
I20260812 11:16:03.453552 8377 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:16:03.453727 8377 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:16:03.453930 8377 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:03.456327 8377 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5796ff84a42444dca1e01e38a34b8156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38607 } }
I20260812 11:16:03.456924 8377 leader_election.cc:302] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5796ff84a42444dca1e01e38a34b8156; no voters:
I20260812 11:16:03.457584 8377 leader_election.cc:288] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:16:03.457751 8393 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:03.458590 8393 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [term 1 LEADER]: Becoming Leader. State: Replica: 5796ff84a42444dca1e01e38a34b8156, State: Running, Role: LEADER
I20260812 11:16:03.459286 8393 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5796ff84a42444dca1e01e38a34b8156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38607 } }
I20260812 11:16:03.459915 8377 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:16:03.462047 8398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5796ff84a42444dca1e01e38a34b8156. Latest consensus state: current_term: 1 leader_uuid: "5796ff84a42444dca1e01e38a34b8156" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5796ff84a42444dca1e01e38a34b8156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38607 } } }
I20260812 11:16:03.462493 8398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:03.463486 8395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5796ff84a42444dca1e01e38a34b8156" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5796ff84a42444dca1e01e38a34b8156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38607 } } }
I20260812 11:16:03.463805 8395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156 [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:03.464856 8403 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:16:03.470449 8403 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:16:03.481945 8403 catalog_manager.cc:1347] Generated new cluster ID: 51ef6bef3ca24912a1a95a46ece6c683
I20260812 11:16:03.482081 8403 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:16:03.497430 8403 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:16:03.498014 8403 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:16:03.515295 8403 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5796ff84a42444dca1e01e38a34b8156: Generated new TSK 0
I20260812 11:16:03.516539 8403 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:16:03.527961 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 8268
W20260812 11:16:03.529567 8368 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.204:49485
W20260812 11:16:03.530398 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 8268: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:16:03.530553 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 8268
2026-08-12T11:16:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2192 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:16:03 dist-test-slave-rmhg krb5kdc[8419](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:16:03 dist-test-slave-rmhg krb5kdc[8419](info): set up 2 sockets
Aug 12 11:16:03 dist-test-slave-rmhg krb5kdc[8419](info): commencing operation
krb5kdc: starting...
W20260812 11:16:04.799814 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.004s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:16:05 dist-test-slave-rmhg krb5kdc[8419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533365, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:16:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:16:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:16:05.137144 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:42899
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:42899
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:05.492498 8438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:05.492841 8438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:05.492964 8438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:05.500811 8438 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:05.500957 8438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:05.501011 8438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:05.501103 8438 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:05.501192 8438 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:05.511554 8438 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:42899
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:42899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:05.513001 8438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:05.514730 8438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:05.528059 8446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:05.528098 8450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:05.528163 8447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:05.529316 8438 server_base.cc:1034] running on GCE node
I20260812 11:16:05.530215 8438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:05.532136 8438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:05.533373 8438 hybrid_clock.cc:648] HybridClock initialized: now 1786533365533299 us; error 62 us; skew 500 ppm
I20260812 11:16:05.533787 8438 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:05 dist-test-slave-rmhg krb5kdc[8419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533365, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:05.541004 8438 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:16:05.542753 8438 webserver.cc:460] Webserver started at http://127.4.26.126:36665/ using document root <none> and password file <none>
I20260812 11:16:05.543538 8438 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:05.543677 8438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:05.544006 8438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:05.547425 8438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "cfbf0e87e7254f74b3dc31b9a53648af"
format_stamp: "Formatted at 2026-08-12 11:16:05 on dist-test-slave-rmhg"
server_key: "7951cda15f4ea2bb728a9a860cb105b5"
server_key_iv: "cd84990277cb0d7f7938d1beaa06dc49"
server_key_version: "encryptionkey@0"
I20260812 11:16:05.548307 8438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "cfbf0e87e7254f74b3dc31b9a53648af"
format_stamp: "Formatted at 2026-08-12 11:16:05 on dist-test-slave-rmhg"
server_key: "7951cda15f4ea2bb728a9a860cb105b5"
server_key_iv: "cd84990277cb0d7f7938d1beaa06dc49"
server_key_version: "encryptionkey@0"
I20260812 11:16:05.554278 8438 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:16:05.558691 8463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:05.560696 8438 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260812 11:16:05.560931 8438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "cfbf0e87e7254f74b3dc31b9a53648af"
format_stamp: "Formatted at 2026-08-12 11:16:05 on dist-test-slave-rmhg"
server_key: "7951cda15f4ea2bb728a9a860cb105b5"
server_key_iv: "cd84990277cb0d7f7938d1beaa06dc49"
server_key_version: "encryptionkey@0"
I20260812 11:16:05.561231 8438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:05.596793 8438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:05.601773 8438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:05.602056 8438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:05.620669 8438 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:42899
I20260812 11:16:05.620712 8568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:42899 every 8 connection(s)
I20260812 11:16:05.622364 8438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:16:05.626762 8569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:05.631596 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 8438
I20260812 11:16:05.631806 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:16:05.632397 4201 external_mini_cluster.cc:1428] Setting key 537be78b7564889158a0b0ac269b2f9f
I20260812 11:16:05.640151 8569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af: Bootstrap starting.
I20260812 11:16:05.644217 8569 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:05.645572 8569 log.cc:824] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:05.649351 8569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af: No bootstrap required, opened a new log
Aug 12 11:16:05 dist-test-slave-rmhg krb5kdc[8419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533365, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:16:05.660022 8569 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfbf0e87e7254f74b3dc31b9a53648af" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42899 } }
I20260812 11:16:05.660589 8569 raft_consensus.cc:374] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:05.660709 8569 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfbf0e87e7254f74b3dc31b9a53648af, State: Initialized, Role: FOLLOWER
I20260812 11:16:05.661278 8574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:05.634639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60503 (local address 127.4.26.126:42899)
0812 11:16:05.635664 (+ 1025us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:05.635686 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:05.636112 (+ 426us) server_negotiation.cc:407] Connection header received
0812 11:16:05.638684 (+ 2572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:05.638718 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:05.639319 (+ 601us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:05.639817 (+ 498us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:05.641407 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:05.643481 (+ 2074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:05.644973 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:05.646303 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:05.646572 (+ 269us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:05.651206 (+ 4634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:05.651220 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:05.651248 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:05.651306 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:05.655794 (+ 4488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:05.656870 (+ 1076us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:05.656881 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:05.656895 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:05.657139 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:05.657699 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:05.657705 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:05.657708 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:05.658541 (+ 833us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:05.658891 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:05.659362 (+ 471us) server_negotiation.cc:299] Negotiation successful
0812 11:16:05.659745 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":722,"thread_start_us":441,"threads_started":1}
I20260812 11:16:05.661507 8569 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfbf0e87e7254f74b3dc31b9a53648af" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42899 } }
I20260812 11:16:05.661825 8569 raft_consensus.cc:388] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:16:05.661967 8569 raft_consensus.cc:482] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:16:05.662168 8569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:05.665458 8569 raft_consensus.cc:504] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfbf0e87e7254f74b3dc31b9a53648af" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42899 } }
I20260812 11:16:05.666095 8569 leader_election.cc:302] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cfbf0e87e7254f74b3dc31b9a53648af; no voters:
I20260812 11:16:05.666236 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:16:05.666808 8569 leader_election.cc:288] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:16:05.666906 8577 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:05.669059 8569 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:16:05.674998 8577 raft_consensus.cc:686] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [term 1 LEADER]: Becoming Leader. State: Replica: cfbf0e87e7254f74b3dc31b9a53648af, State: Running, Role: LEADER
I20260812 11:16:05.675952 8577 consensus_queue.cc:237] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfbf0e87e7254f74b3dc31b9a53648af" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42899 } }
I20260812 11:16:05.679461 8579 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cfbf0e87e7254f74b3dc31b9a53648af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfbf0e87e7254f74b3dc31b9a53648af" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42899 } } }
I20260812 11:16:05.679471 8586 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [sys.catalog]: SysCatalogTable state changed. Reason: New leader cfbf0e87e7254f74b3dc31b9a53648af. Latest consensus state: current_term: 1 leader_uuid: "cfbf0e87e7254f74b3dc31b9a53648af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfbf0e87e7254f74b3dc31b9a53648af" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 42899 } } }
I20260812 11:16:05.680002 8586 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:05.680002 8579 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:05.681849 8609 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:16:05.687585 8609 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:16:05.697640 8574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:05.675734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37415 (local address 127.4.26.126:42899)
0812 11:16:05.676013 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:05.676019 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:05.676607 (+ 588us) server_negotiation.cc:407] Connection header received
0812 11:16:05.676877 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:05.676884 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:05.676989 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:05.677115 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:05.681809 (+ 4694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:05.682957 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:05.684880 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:05.685588 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:05.685729 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:05.689388 (+ 3659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:05.689395 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:05.689400 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:05.689449 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:05.693485 (+ 4036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:05.694516 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:05.694522 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:05.694526 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:05.694697 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:05.695350 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:05.695355 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:05.695358 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:05.695864 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:05.696130 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:05.696937 (+ 807us) server_negotiation.cc:299] Negotiation successful
0812 11:16:05.697204 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150}
I20260812 11:16:05.705498 8609 catalog_manager.cc:1347] Generated new cluster ID: 5e42ab00fac74ae4815dc3ffe5377794
I20260812 11:16:05.705726 8609 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:16:05.740945 8609 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:16:05.742434 8609 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:16:05.752004 8609 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cfbf0e87e7254f74b3dc31b9a53648af: Generated new TSK 0
I20260812 11:16:05.753202 8609 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:16:05.766059 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 8438
I20260812 11:16:05.767617 8560 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:05.863834 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 8438
W20260812 11:16:05.889434 8417 connection.cc:535] client connection to 127.4.26.126:42899 recv error: Network error: failed to read from TLS socket (remote: 127.4.26.126:42899): Connection reset by peer (error 104)
2026-08-12T11:16:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2331 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:16:05 dist-test-slave-rmhg krb5kdc[8626](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:16:05 dist-test-slave-rmhg krb5kdc[8626](info): set up 2 sockets
Aug 12 11:16:05 dist-test-slave-rmhg krb5kdc[8626](info): commencing operation
krb5kdc: starting...
W20260812 11:16:07.175696 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:16:07 dist-test-slave-rmhg krb5kdc[8626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533367, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:16:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:16:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:16:07.520306 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:45249
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:36543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:45249
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:07.888609 8649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:07.888948 8649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:07.889067 8649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:07.896589 8649 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:07.896733 8649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:07.896786 8649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:07.896872 8649 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:07.896929 8649 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:07.907295 8649 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:36543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:45249
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:45249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:07.908619 8649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:07.909979 8649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:07.922247 8654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:07.922297 8659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:07.922309 8656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:07.923084 8649 server_base.cc:1034] running on GCE node
I20260812 11:16:07.923883 8649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:07.925477 8649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:07.926709 8649 hybrid_clock.cc:648] HybridClock initialized: now 1786533367926655 us; error 47 us; skew 500 ppm
I20260812 11:16:07.927122 8649 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:07 dist-test-slave-rmhg krb5kdc[8626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533367, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:07.930533 8649 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:16:07.932189 8649 webserver.cc:460] Webserver started at http://127.4.26.126:46047/ using document root <none> and password file <none>
I20260812 11:16:07.932920 8649 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:07.933063 8649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:07.933422 8649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:07.936744 8649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "ca108ad1e4cd4e8184d26ab37ba0d054"
format_stamp: "Formatted at 2026-08-12 11:16:07 on dist-test-slave-rmhg"
server_key: "ac6194e655d3f100d3d986fb8119b77f"
server_key_iv: "42314a8d9f9df64ca77f8c15647a9fec"
server_key_version: "encryptionkey@0"
I20260812 11:16:07.937626 8649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "ca108ad1e4cd4e8184d26ab37ba0d054"
format_stamp: "Formatted at 2026-08-12 11:16:07 on dist-test-slave-rmhg"
server_key: "ac6194e655d3f100d3d986fb8119b77f"
server_key_iv: "42314a8d9f9df64ca77f8c15647a9fec"
server_key_version: "encryptionkey@0"
I20260812 11:16:07.943282 8649 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:16:07.947467 8670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:07.949091 8649 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260812 11:16:07.949327 8649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "ca108ad1e4cd4e8184d26ab37ba0d054"
format_stamp: "Formatted at 2026-08-12 11:16:07 on dist-test-slave-rmhg"
server_key: "ac6194e655d3f100d3d986fb8119b77f"
server_key_iv: "42314a8d9f9df64ca77f8c15647a9fec"
server_key_version: "encryptionkey@0"
I20260812 11:16:07.949548 8649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:07.990599 8649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:07.995565 8649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:07.995925 8649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:08.014953 8649 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:45249
I20260812 11:16:08.014976 8763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:45249 every 8 connection(s)
I20260812 11:16:08.016463 8649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:16:08.018030 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 8649
I20260812 11:16:08.018215 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:16:08.018828 4201 external_mini_cluster.cc:1428] Setting key 864bbecc7ff9db2af9f3acd1ab339d55
I20260812 11:16:08.021476 8764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:08.033479 8768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:08.020813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44183 (local address 127.4.26.126:45249)
0812 11:16:08.021695 (+ 882us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:08.021709 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:08.021765 (+ 56us) server_negotiation.cc:407] Connection header received
0812 11:16:08.023480 (+ 1715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:08.023504 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:08.023947 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:08.024331 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:08.025051 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:08.026464 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:08.028410 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:08.029211 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:08.029364 (+ 153us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:08.030817 (+ 1453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:08.030825 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:08.030846 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:16:08.031530 (+ 684us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:08.031628 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:16:08.031659 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:08.031788 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:08.032108 (+ 320us) server_negotiation.cc:299] Negotiation successful
0812 11:16:08.032348 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":405,"threads_started":1}
I20260812 11:16:08.034317 8764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054: Bootstrap starting.
I20260812 11:16:08.037689 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:16:08.037698 8764 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:08.038985 8764 log.cc:824] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:08.042614 8764 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054: No bootstrap required, opened a new log
I20260812 11:16:08.049923 8768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:08.042833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35353 (local address 127.4.26.126:45249)
0812 11:16:08.043015 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:08.043021 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:08.043530 (+ 509us) server_negotiation.cc:407] Connection header received
0812 11:16:08.043709 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:08.043714 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:08.043791 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:08.043916 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:08.044353 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:08.045603 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:08.046970 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:08.047704 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:08.047836 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:08.049099 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:08.049106 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:08.049110 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:16:08.049141 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:08.049211 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:16:08.049234 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:08.049362 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:08.049528 (+ 166us) server_negotiation.cc:299] Negotiation successful
0812 11:16:08.049587 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260812 11:16:08.052220 8764 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca108ad1e4cd4e8184d26ab37ba0d054" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 45249 } }
I20260812 11:16:08.052635 8764 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:08.052722 8764 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca108ad1e4cd4e8184d26ab37ba0d054, State: Initialized, Role: FOLLOWER
I20260812 11:16:08.053380 8764 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca108ad1e4cd4e8184d26ab37ba0d054" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 45249 } }
I20260812 11:16:08.053622 8764 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:16:08.053762 8764 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:16:08.053920 8764 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:08.056833 8764 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca108ad1e4cd4e8184d26ab37ba0d054" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 45249 } }
I20260812 11:16:08.057510 8764 leader_election.cc:302] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca108ad1e4cd4e8184d26ab37ba0d054; no voters:
I20260812 11:16:08.058154 8764 leader_election.cc:288] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:16:08.058307 8778 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:08.059039 8778 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [term 1 LEADER]: Becoming Leader. State: Replica: ca108ad1e4cd4e8184d26ab37ba0d054, State: Running, Role: LEADER
I20260812 11:16:08.059618 8778 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca108ad1e4cd4e8184d26ab37ba0d054" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 45249 } }
I20260812 11:16:08.060237 8764 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:16:08.062426 8780 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca108ad1e4cd4e8184d26ab37ba0d054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca108ad1e4cd4e8184d26ab37ba0d054" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 45249 } } }
I20260812 11:16:08.062836 8780 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:08.063759 8783 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca108ad1e4cd4e8184d26ab37ba0d054. Latest consensus state: current_term: 1 leader_uuid: "ca108ad1e4cd4e8184d26ab37ba0d054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca108ad1e4cd4e8184d26ab37ba0d054" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 45249 } } }
I20260812 11:16:08.064188 8783 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054 [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:08.066129 8788 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:16:08.072063 8788 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:16:08.083101 8788 catalog_manager.cc:1347] Generated new cluster ID: 558fdf93ab3f4dcfbf173edc1ac5d346
I20260812 11:16:08.083233 8788 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:16:08.114099 8788 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:16:08.116180 8788 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:16:08.129818 8788 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca108ad1e4cd4e8184d26ab37ba0d054: Generated new TSK 0
I20260812 11:16:08.130955 8788 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:16:08.148108 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 8649
W20260812 11:16:08.149748 8759 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:44183
W20260812 11:16:08.150557 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 8649: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:16:08.150728 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 8649
W20260812 11:16:08.175033 8623 connection.cc:535] client connection to 127.4.26.126:45249 recv error: Network error: failed to read from TLS socket (remote: 127.4.26.126:45249): Connection reset by peer (error 104)
2026-08-12T11:16:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2285 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:16:08 dist-test-slave-rmhg krb5kdc[8819](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:16:08 dist-test-slave-rmhg krb5kdc[8819](info): set up 2 sockets
Aug 12 11:16:08 dist-test-slave-rmhg krb5kdc[8819](info): commencing operation
krb5kdc: starting...
W20260812 11:16:09.446903 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:16:09 dist-test-slave-rmhg krb5kdc[8819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533369, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:16:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:16:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:16:09.796936 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:34785
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:34703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:34785
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:10.175650 8843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:10.175994 8843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:10.176127 8843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:10.183766 8843 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:10.183920 8843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:10.183977 8843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:10.184073 8843 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:10.184128 8843 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:10.195061 8843 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:34703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:34785
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:34785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:10.196578 8843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:10.198118 8843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:10.211033 8859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:10.211107 8858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:10.211088 8861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:10.211347 8843 server_base.cc:1034] running on GCE node
I20260812 11:16:10.212707 8843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:10.214504 8843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:10.215792 8843 hybrid_clock.cc:648] HybridClock initialized: now 1786533370215709 us; error 72 us; skew 500 ppm
I20260812 11:16:10.216228 8843 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:10 dist-test-slave-rmhg krb5kdc[8819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533370, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:10.219874 8843 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:16:10.221777 8843 webserver.cc:460] Webserver started at http://127.4.26.126:37933/ using document root <none> and password file <none>
I20260812 11:16:10.222615 8843 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:10.222762 8843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:10.223095 8843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:10.226477 8843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "1abe17e0d1b14325826ec015949ff4eb"
format_stamp: "Formatted at 2026-08-12 11:16:10 on dist-test-slave-rmhg"
server_key: "dced8a85729990161af66281680a850d"
server_key_iv: "96d73e47d4901c03844ef94d6fbaee38"
server_key_version: "encryptionkey@0"
I20260812 11:16:10.227324 8843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "1abe17e0d1b14325826ec015949ff4eb"
format_stamp: "Formatted at 2026-08-12 11:16:10 on dist-test-slave-rmhg"
server_key: "dced8a85729990161af66281680a850d"
server_key_iv: "96d73e47d4901c03844ef94d6fbaee38"
server_key_version: "encryptionkey@0"
I20260812 11:16:10.233363 8843 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260812 11:16:10.237474 8876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:10.239207 8843 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260812 11:16:10.239427 8843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "1abe17e0d1b14325826ec015949ff4eb"
format_stamp: "Formatted at 2026-08-12 11:16:10 on dist-test-slave-rmhg"
server_key: "dced8a85729990161af66281680a850d"
server_key_iv: "96d73e47d4901c03844ef94d6fbaee38"
server_key_version: "encryptionkey@0"
I20260812 11:16:10.239665 8843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:10.246235 8843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:10.250773 8843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:10.251080 8843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:10.270691 8843 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:34785
I20260812 11:16:10.270723 8959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:34785 every 8 connection(s)
I20260812 11:16:10.272257 8843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:16:10.273461 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 8843
I20260812 11:16:10.273715 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:16:10.274235 4201 external_mini_cluster.cc:1428] Setting key f6c7a0af58b3ba3c30dc48ab4220af27
I20260812 11:16:10.277397 8961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:10.282572 8965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:10.276145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49075 (local address 127.4.26.126:34785)
0812 11:16:10.276952 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:10.276964 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:10.277009 (+ 45us) server_negotiation.cc:407] Connection header received
0812 11:16:10.278825 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:10.278851 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:10.279222 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:10.279594 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:10.280720 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:10.280727 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:10.280741 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:16:10.280757 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:10.280838 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:16:10.280860 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:10.281118 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:10.281313 (+ 195us) server_negotiation.cc:299] Negotiation successful
0812 11:16:10.281509 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":354,"threads_started":1}
I20260812 11:16:10.286682 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:16:10.289433 8961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb: Bootstrap starting.
I20260812 11:16:10.293290 8961 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:10.294277 8965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:10.291300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51595 (local address 127.4.26.126:34785)
0812 11:16:10.291524 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:10.291535 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:10.292053 (+ 518us) server_negotiation.cc:407] Connection header received
0812 11:16:10.292222 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:10.292227 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:10.292297 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:10.292420 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:10.293584 (+ 1164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:10.293590 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:10.293594 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:16:10.293614 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:10.293674 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:16:10.293701 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:10.293867 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:10.293943 (+ 76us) server_negotiation.cc:299] Negotiation successful
0812 11:16:10.294006 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:16:10.294785 8961 log.cc:824] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:10.297931 8961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb: No bootstrap required, opened a new log
I20260812 11:16:10.305889 8961 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abe17e0d1b14325826ec015949ff4eb" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34785 } }
I20260812 11:16:10.306326 8961 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:10.306434 8961 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abe17e0d1b14325826ec015949ff4eb, State: Initialized, Role: FOLLOWER
I20260812 11:16:10.307039 8961 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abe17e0d1b14325826ec015949ff4eb" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34785 } }
I20260812 11:16:10.307261 8961 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:16:10.307405 8961 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:16:10.307566 8961 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:10.310141 8961 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abe17e0d1b14325826ec015949ff4eb" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34785 } }
I20260812 11:16:10.310747 8961 leader_election.cc:302] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1abe17e0d1b14325826ec015949ff4eb; no voters:
I20260812 11:16:10.311358 8961 leader_election.cc:288] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:16:10.311514 8975 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:10.312223 8975 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [term 1 LEADER]: Becoming Leader. State: Replica: 1abe17e0d1b14325826ec015949ff4eb, State: Running, Role: LEADER
I20260812 11:16:10.312808 8975 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abe17e0d1b14325826ec015949ff4eb" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34785 } }
I20260812 11:16:10.313496 8961 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:16:10.316370 8977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1abe17e0d1b14325826ec015949ff4eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abe17e0d1b14325826ec015949ff4eb" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34785 } } }
I20260812 11:16:10.316854 8982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1abe17e0d1b14325826ec015949ff4eb. Latest consensus state: current_term: 1 leader_uuid: "1abe17e0d1b14325826ec015949ff4eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abe17e0d1b14325826ec015949ff4eb" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 34785 } } }
I20260812 11:16:10.317202 8977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:10.317257 8982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:10.319020 8989 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:16:10.325035 8989 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:16:10.336010 8989 catalog_manager.cc:1347] Generated new cluster ID: 5546fb548f3e424c88461b6acfefe1a2
I20260812 11:16:10.336163 8989 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:16:10.360532 8989 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:16:10.361387 8989 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:16:10.372426 8989 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1abe17e0d1b14325826ec015949ff4eb: Generated new TSK 0
I20260812 11:16:10.373481 8989 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:16:10.381548 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 8843
W20260812 11:16:10.383563 8950 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49075
W20260812 11:16:10.384397 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 8843: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:16:10.384575 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 8843
2026-08-12T11:16:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2246 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:16:10 dist-test-slave-rmhg krb5kdc[9008](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:16:10 dist-test-slave-rmhg krb5kdc[9008](info): set up 2 sockets
Aug 12 11:16:10 dist-test-slave-rmhg krb5kdc[9008](info): commencing operation
krb5kdc: starting...
W20260812 11:16:11.682757 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.002s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:16:11 dist-test-slave-rmhg krb5kdc[9008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:16:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:16:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:16:12.029866 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:44129
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:40147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:44129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:12.392184 9031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:12.392515 9031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:12.392652 9031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:12.400138 9031 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:12.400288 9031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:12.400337 9031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:12.400422 9031 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:12.400480 9031 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:12.411253 9031 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:40147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:44129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:44129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:12.412669 9031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:12.414073 9031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:12.426235 9038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:12.426168 9039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:12.426203 9044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:12.427033 9031 server_base.cc:1034] running on GCE node
I20260812 11:16:12.427863 9031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:12.429375 9031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:12.430622 9031 hybrid_clock.cc:648] HybridClock initialized: now 1786533372430554 us; error 36 us; skew 500 ppm
I20260812 11:16:12.430989 9031 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:12 dist-test-slave-rmhg krb5kdc[9008](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533372, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:12.439368 9031 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:16:12.441283 9031 webserver.cc:460] Webserver started at http://127.4.26.126:41085/ using document root <none> and password file <none>
I20260812 11:16:12.442026 9031 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:12.442147 9031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:12.442422 9031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:12.445708 9031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "974595944ded4592a0af733622099915"
format_stamp: "Formatted at 2026-08-12 11:16:12 on dist-test-slave-rmhg"
server_key: "32c8e4c3b2581d397f2f53fbae230372"
server_key_iv: "895dfe504157ecdb23c9593246c69ade"
server_key_version: "encryptionkey@0"
I20260812 11:16:12.446512 9031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "974595944ded4592a0af733622099915"
format_stamp: "Formatted at 2026-08-12 11:16:12 on dist-test-slave-rmhg"
server_key: "32c8e4c3b2581d397f2f53fbae230372"
server_key_iv: "895dfe504157ecdb23c9593246c69ade"
server_key_version: "encryptionkey@0"
I20260812 11:16:12.452121 9031 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260812 11:16:12.455780 9052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:12.457247 9031 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260812 11:16:12.457414 9031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "974595944ded4592a0af733622099915"
format_stamp: "Formatted at 2026-08-12 11:16:12 on dist-test-slave-rmhg"
server_key: "32c8e4c3b2581d397f2f53fbae230372"
server_key_iv: "895dfe504157ecdb23c9593246c69ade"
server_key_version: "encryptionkey@0"
I20260812 11:16:12.457626 9031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:12.485422 9031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:12.489859 9031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:12.490127 9031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:12.508806 9031 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:44129
I20260812 11:16:12.508838 9139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:44129 every 8 connection(s)
I20260812 11:16:12.510330 9031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:16:12.514581 9140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:12.515448 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 9031
I20260812 11:16:12.515669 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:16:12.516259 4201 external_mini_cluster.cc:1428] Setting key 18e2cee998723713550579d184092958
I20260812 11:16:12.530401 9140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915: Bootstrap starting.
Aug 12 11:16:12 dist-test-slave-rmhg krb5kdc[9008](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:16:12.534631 9140 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:12.535962 9140 log.cc:824] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:12.539175 9140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915: No bootstrap required, opened a new log
I20260812 11:16:12.542277 9151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:12.518407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34143 (local address 127.4.26.126:44129)
0812 11:16:12.519346 (+ 939us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:12.519363 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:12.519410 (+ 47us) server_negotiation.cc:407] Connection header received
0812 11:16:12.521514 (+ 2104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:12.521546 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:12.522093 (+ 547us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:12.522521 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:12.524545 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:12.526018 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:12.528049 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:12.528917 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:12.529108 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:12.534404 (+ 5296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:12.534414 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:12.534433 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:12.534487 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:12.537789 (+ 3302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:12.538597 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:12.538605 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:12.538613 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:12.538796 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:12.539221 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:12.539224 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:12.539227 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:12.539839 (+ 612us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:12.540175 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:12.540617 (+ 442us) server_negotiation.cc:299] Negotiation successful
0812 11:16:12.541124 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":703,"thread_start_us":401,"threads_started":1}
I20260812 11:16:12.546689 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:16:12.548153 9140 raft_consensus.cc:348] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974595944ded4592a0af733622099915" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44129 } }
I20260812 11:16:12.548580 9140 raft_consensus.cc:374] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:12.548691 9140 raft_consensus.cc:729] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974595944ded4592a0af733622099915, State: Initialized, Role: FOLLOWER
I20260812 11:16:12.549347 9140 consensus_queue.cc:260] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974595944ded4592a0af733622099915" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44129 } }
I20260812 11:16:12.549647 9140 raft_consensus.cc:388] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:16:12.549805 9140 raft_consensus.cc:482] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:16:12.550002 9140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:12.552820 9140 raft_consensus.cc:504] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974595944ded4592a0af733622099915" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44129 } }
I20260812 11:16:12.553619 9140 leader_election.cc:302] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 974595944ded4592a0af733622099915; no voters:
I20260812 11:16:12.554421 9140 leader_election.cc:288] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:16:12.554493 9171 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:12.556521 9171 raft_consensus.cc:686] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [term 1 LEADER]: Becoming Leader. State: Replica: 974595944ded4592a0af733622099915, State: Running, Role: LEADER
I20260812 11:16:12.556734 9140 sys_catalog.cc:564] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:16:12.557229 9171 consensus_queue.cc:237] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974595944ded4592a0af733622099915" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44129 } }
I20260812 11:16:12.564898 9173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "974595944ded4592a0af733622099915" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974595944ded4592a0af733622099915" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44129 } } }
I20260812 11:16:12.565434 9173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:12.565423 9175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 974595944ded4592a0af733622099915. Latest consensus state: current_term: 1 leader_uuid: "974595944ded4592a0af733622099915" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974595944ded4592a0af733622099915" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 44129 } } }
I20260812 11:16:12.565755 9175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915 [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:12.571826 9151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:12.551541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42391 (local address 127.4.26.126:44129)
0812 11:16:12.551759 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:12.551765 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:12.552115 (+ 350us) server_negotiation.cc:407] Connection header received
0812 11:16:12.552282 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:12.552285 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:12.552351 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:12.552436 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:12.554785 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:12.556111 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:12.558570 (+ 2459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:12.559294 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:12.559443 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:12.563180 (+ 3737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:12.563187 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:12.563192 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:12.563242 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:12.567304 (+ 4062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:12.568276 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:12.568283 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:12.568287 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:12.568463 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:12.568966 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:12.568971 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:12.568975 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:12.569456 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:12.570967 (+ 1511us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:12.571138 (+ 171us) server_negotiation.cc:299] Negotiation successful
0812 11:16:12.571406 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260812 11:16:12.575601 9181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:16:12.581614 9181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:16:12.591907 9181 catalog_manager.cc:1347] Generated new cluster ID: 22d4d86a24af4bb6a18e74cfa4632c70
I20260812 11:16:12.592054 9181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:16:12.634060 9181 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:16:12.635419 9181 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:16:12.650748 9181 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 974595944ded4592a0af733622099915: Generated new TSK 0
I20260812 11:16:12.651715 9181 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:16:12.658371 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 9031
I20260812 11:16:12.659934 9133 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:12.756556 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 9031
2026-08-12T11:16:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2357 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:16:12 dist-test-slave-rmhg krb5kdc[9203](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:16:12 dist-test-slave-rmhg krb5kdc[9203](info): set up 2 sockets
Aug 12 11:16:12 dist-test-slave-rmhg krb5kdc[9203](info): commencing operation
krb5kdc: starting...
W20260812 11:16:14.035369 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:16:14 dist-test-slave-rmhg krb5kdc[9203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533374, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:16:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:16:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:16:14.383126 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:33695
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:43273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:33695
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:14.742050 9225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:14.742362 9225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:14.742463 9225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:14.749915 9225 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:14.750054 9225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:14.750110 9225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:14.750170 9225 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:14.750216 9225 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:14.760548 9225 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:43273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:33695
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:33695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:14.761981 9225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:14.763358 9225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:14.775761 9234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:14.775738 9235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:14.775810 9238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:14.776705 9225 server_base.cc:1034] running on GCE node
I20260812 11:16:14.777632 9225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:14.779187 9225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:14.780416 9225 hybrid_clock.cc:648] HybridClock initialized: now 1786533374780363 us; error 50 us; skew 500 ppm
I20260812 11:16:14.780851 9225 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:14 dist-test-slave-rmhg krb5kdc[9203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533374, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:14.784198 9225 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:16:14.785815 9225 webserver.cc:460] Webserver started at http://127.4.26.126:32957/ using document root <none> and password file <none>
I20260812 11:16:14.786531 9225 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:14.786684 9225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:14.786976 9225 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:14.790184 9225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "62ad2638e9134af6a67291a34cd6d81a"
format_stamp: "Formatted at 2026-08-12 11:16:14 on dist-test-slave-rmhg"
server_key: "9ef8f0be53cafd3c77025347bd65919c"
server_key_iv: "1a66aae90a9b6fe5630c72d76f4aea60"
server_key_version: "encryptionkey@0"
I20260812 11:16:14.790946 9225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "62ad2638e9134af6a67291a34cd6d81a"
format_stamp: "Formatted at 2026-08-12 11:16:14 on dist-test-slave-rmhg"
server_key: "9ef8f0be53cafd3c77025347bd65919c"
server_key_iv: "1a66aae90a9b6fe5630c72d76f4aea60"
server_key_version: "encryptionkey@0"
I20260812 11:16:14.796959 9225 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 11:16:14.800844 9246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:14.802419 9225 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:16:14.802623 9225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "62ad2638e9134af6a67291a34cd6d81a"
format_stamp: "Formatted at 2026-08-12 11:16:14 on dist-test-slave-rmhg"
server_key: "9ef8f0be53cafd3c77025347bd65919c"
server_key_iv: "1a66aae90a9b6fe5630c72d76f4aea60"
server_key_version: "encryptionkey@0"
I20260812 11:16:14.802831 9225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:14.825417 9225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:14.830487 9225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:14.830816 9225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:14.850205 9225 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:33695
I20260812 11:16:14.850240 9329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:33695 every 8 connection(s)
I20260812 11:16:14.851714 9225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:16:14.856098 9330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:14.858523 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 9225
I20260812 11:16:14.858727 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:16:14.859287 4201 external_mini_cluster.cc:1428] Setting key b4d2da9479e0d7165d28796d974fbbb6
I20260812 11:16:14.870204 9330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a: Bootstrap starting.
I20260812 11:16:14.874315 9330 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:14.875500 9337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:14.861530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47831 (local address 127.4.26.126:33695)
0812 11:16:14.862571 (+ 1041us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:14.862586 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:14.862647 (+ 61us) server_negotiation.cc:407] Connection header received
0812 11:16:14.864685 (+ 2038us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:14.864719 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:14.865302 (+ 583us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:14.865734 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:14.866529 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:14.868027 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:14.870081 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:14.870970 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:14.871140 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:14.872673 (+ 1533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:14.872682 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:14.872700 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:16:14.873385 (+ 685us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:14.873494 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:16:14.873527 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:14.873633 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:14.873972 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 11:16:14.874334 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":778,"thread_start_us":509,"threads_started":1}
I20260812 11:16:14.875547 9330 log.cc:824] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:14.879279 9330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a: No bootstrap required, opened a new log
I20260812 11:16:14.880613 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:16:14.890566 9330 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ad2638e9134af6a67291a34cd6d81a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33695 } }
I20260812 11:16:14.891242 9330 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:14.891386 9330 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62ad2638e9134af6a67291a34cd6d81a, State: Initialized, Role: FOLLOWER
I20260812 11:16:14.892140 9330 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ad2638e9134af6a67291a34cd6d81a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33695 } }
I20260812 11:16:14.892423 9330 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:16:14.892590 9330 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:16:14.892768 9330 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:14.893774 9337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:14.886391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59581 (local address 127.4.26.126:33695)
0812 11:16:14.886617 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:14.886628 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:14.887115 (+ 487us) server_negotiation.cc:407] Connection header received
0812 11:16:14.887298 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:14.887303 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:14.887396 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:14.887538 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:14.888118 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:14.889292 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:14.890802 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:14.891518 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:14.891675 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:14.892938 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:14.892947 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:14.892952 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:16:14.892977 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:14.893029 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:16:14.893052 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:14.893199 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:14.893330 (+ 131us) server_negotiation.cc:299] Negotiation successful
0812 11:16:14.893427 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260812 11:16:14.895772 9330 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ad2638e9134af6a67291a34cd6d81a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33695 } }
I20260812 11:16:14.896317 9330 leader_election.cc:302] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62ad2638e9134af6a67291a34cd6d81a; no voters:
I20260812 11:16:14.896968 9330 leader_election.cc:288] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:16:14.897111 9347 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:14.898326 9347 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [term 1 LEADER]: Becoming Leader. State: Replica: 62ad2638e9134af6a67291a34cd6d81a, State: Running, Role: LEADER
I20260812 11:16:14.898936 9347 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ad2638e9134af6a67291a34cd6d81a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33695 } }
I20260812 11:16:14.899395 9330 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:16:14.902033 9351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62ad2638e9134af6a67291a34cd6d81a. Latest consensus state: current_term: 1 leader_uuid: "62ad2638e9134af6a67291a34cd6d81a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ad2638e9134af6a67291a34cd6d81a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33695 } } }
I20260812 11:16:14.902472 9351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:14.902922 9350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62ad2638e9134af6a67291a34cd6d81a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62ad2638e9134af6a67291a34cd6d81a" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 33695 } } }
I20260812 11:16:14.903373 9350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:14.907007 9360 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:16:14.913250 9360 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:16:14.923943 9360 catalog_manager.cc:1347] Generated new cluster ID: be156a6947b34872ac592f021ea7f9df
I20260812 11:16:14.924098 9360 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:16:14.942247 9360 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:16:14.943645 9360 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:16:14.950577 9360 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62ad2638e9134af6a67291a34cd6d81a: Generated new TSK 0
I20260812 11:16:14.951488 9360 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:16:14.964169 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 9225
W20260812 11:16:14.965739 9320 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:47831
W20260812 11:16:14.966566 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 9225: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:16:14.966733 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 9225
2026-08-12T11:16:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2216 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:16:15 dist-test-slave-rmhg krb5kdc[9378](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:16:15 dist-test-slave-rmhg krb5kdc[9378](info): set up 2 sockets
Aug 12 11:16:15 dist-test-slave-rmhg krb5kdc[9378](info): commencing operation
krb5kdc: starting...
W20260812 11:16:16.251747 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:16:16 dist-test-slave-rmhg krb5kdc[9378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533376, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:16:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:16:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:16:16.600176 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37701
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:41811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:37701
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:16.962275 9397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:16.962613 9397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:16.962805 9397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:16.970393 9397 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:16.970538 9397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:16.970593 9397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:16.970690 9397 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:16.970744 9397 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:16.981252 9397 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:41811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:37701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:16.982681 9397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:16.984167 9397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:16.998344 9407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:16.998898 9404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:16.999010 9403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:16.999830 9397 server_base.cc:1034] running on GCE node
I20260812 11:16:17.001844 9397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:17.005214 9397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:17.006656 9397 hybrid_clock.cc:648] HybridClock initialized: now 1786533377006566 us; error 80 us; skew 500 ppm
I20260812 11:16:17.007112 9397 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:17 dist-test-slave-rmhg krb5kdc[9378](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533377, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:17.011536 9397 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:16:17.013738 9397 webserver.cc:460] Webserver started at http://127.4.26.126:36957/ using document root <none> and password file <none>
I20260812 11:16:17.014753 9397 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:17.014922 9397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:17.015250 9397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:17.019363 9397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "90ccc4eb5a1a4cb081f7a29efe139d26"
format_stamp: "Formatted at 2026-08-12 11:16:17 on dist-test-slave-rmhg"
server_key: "4c841e0833ef8c6bfcde1a4bb80d2e47"
server_key_iv: "91cebfa330841c9a7f6cd6ace1746075"
server_key_version: "encryptionkey@0"
I20260812 11:16:17.020758 9397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "90ccc4eb5a1a4cb081f7a29efe139d26"
format_stamp: "Formatted at 2026-08-12 11:16:17 on dist-test-slave-rmhg"
server_key: "4c841e0833ef8c6bfcde1a4bb80d2e47"
server_key_iv: "91cebfa330841c9a7f6cd6ace1746075"
server_key_version: "encryptionkey@0"
I20260812 11:16:17.031598 9397 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.005s sys 0.003s
I20260812 11:16:17.036724 9417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:17.038628 9397 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 11:16:17.038849 9397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "90ccc4eb5a1a4cb081f7a29efe139d26"
format_stamp: "Formatted at 2026-08-12 11:16:17 on dist-test-slave-rmhg"
server_key: "4c841e0833ef8c6bfcde1a4bb80d2e47"
server_key_iv: "91cebfa330841c9a7f6cd6ace1746075"
server_key_version: "encryptionkey@0"
I20260812 11:16:17.039121 9397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:17.046687 9397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:17.051702 9397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:17.052011 9397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:17.071355 9397 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:37701
I20260812 11:16:17.071403 9513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:37701 every 8 connection(s)
I20260812 11:16:17.072911 9397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:16:17.077086 9514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:17.079470 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 9397
I20260812 11:16:17.079677 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:16:17.080278 4201 external_mini_cluster.cc:1428] Setting key 66ae342219c5a641d6f430619227046d
I20260812 11:16:17.089116 9518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:17.082465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58815 (local address 127.4.26.126:37701)
0812 11:16:17.083343 (+ 878us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:17.083359 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:17.083410 (+ 51us) server_negotiation.cc:407] Connection header received
0812 11:16:17.085333 (+ 1923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:17.085363 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:17.085769 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:17.086159 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:17.087229 (+ 1070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:17.087236 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:17.087254 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:16:17.087268 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:17.087335 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:16:17.087365 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:17.087597 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:17.087764 (+ 167us) server_negotiation.cc:299] Negotiation successful
0812 11:16:17.087979 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":359,"threads_started":1}
I20260812 11:16:17.091033 9514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26: Bootstrap starting.
I20260812 11:16:17.093447 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:16:17.094617 9514 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:17.095692 9514 log.cc:824] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:17.099264 9514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26: No bootstrap required, opened a new log
I20260812 11:16:17.100611 9518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:17.098143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35929 (local address 127.4.26.126:37701)
0812 11:16:17.098331 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:17.098337 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:17.098622 (+ 285us) server_negotiation.cc:407] Connection header received
0812 11:16:17.098768 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:17.098773 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:17.098837 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:17.098961 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:17.099983 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:17.099990 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:17.099994 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0812 11:16:17.100023 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:17.100078 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0812 11:16:17.100100 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:17.100225 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:17.100270 (+ 45us) server_negotiation.cc:299] Negotiation successful
0812 11:16:17.100329 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260812 11:16:17.108016 9514 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ccc4eb5a1a4cb081f7a29efe139d26" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37701 } }
I20260812 11:16:17.108433 9514 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 11:16:17.108548 9514 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ccc4eb5a1a4cb081f7a29efe139d26, State: Initialized, Role: FOLLOWER
I20260812 11:16:17.109243 9514 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ccc4eb5a1a4cb081f7a29efe139d26" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37701 } }
I20260812 11:16:17.109488 9514 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 11:16:17.109638 9514 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 11:16:17.109790 9514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:17.112121 9514 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ccc4eb5a1a4cb081f7a29efe139d26" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37701 } }
I20260812 11:16:17.112672 9514 leader_election.cc:302] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90ccc4eb5a1a4cb081f7a29efe139d26; no voters:
I20260812 11:16:17.113365 9514 leader_election.cc:288] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 11:16:17.113440 9532 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:17.114624 9532 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [term 1 LEADER]: Becoming Leader. State: Replica: 90ccc4eb5a1a4cb081f7a29efe139d26, State: Running, Role: LEADER
I20260812 11:16:17.115177 9532 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ccc4eb5a1a4cb081f7a29efe139d26" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37701 } }
I20260812 11:16:17.115548 9514 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:16:17.117857 9538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90ccc4eb5a1a4cb081f7a29efe139d26. Latest consensus state: current_term: 1 leader_uuid: "90ccc4eb5a1a4cb081f7a29efe139d26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ccc4eb5a1a4cb081f7a29efe139d26" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37701 } } }
I20260812 11:16:17.118420 9538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:17.118921 9533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90ccc4eb5a1a4cb081f7a29efe139d26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90ccc4eb5a1a4cb081f7a29efe139d26" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37701 } } }
I20260812 11:16:17.119247 9533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26 [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:17.119524 9544 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:16:17.126099 9544 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:16:17.134956 9544 catalog_manager.cc:1347] Generated new cluster ID: 8a72b86a61a84bd088b2c3bb3f7b1b28
I20260812 11:16:17.135102 9544 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:16:17.162015 9544 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:16:17.162611 9544 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:16:17.169090 9544 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90ccc4eb5a1a4cb081f7a29efe139d26: Generated new TSK 0
I20260812 11:16:17.170101 9544 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:16:17.179471 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 9397
W20260812 11:16:17.180861 9506 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58815
W20260812 11:16:17.181771 4201 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 9397: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260812 11:16:17.181944 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 9397
2026-08-12T11:16:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2212 ms)
[----------] 18 tests from AuthTokenIssuingTest (40600 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:16:17 dist-test-slave-rmhg krb5kdc[9566](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:16:17 dist-test-slave-rmhg krb5kdc[9566](info): set up 2 sockets
Aug 12 11:16:17 dist-test-slave-rmhg krb5kdc[9566](info): commencing operation
krb5kdc: starting...
W20260812 11:16:18.473775 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.246s user 0.003s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:16:18 dist-test-slave-rmhg krb5kdc[9566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533378, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:16:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:16:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:16:18.825742 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37649
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:43869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:37649,127.4.26.125:37259,127.4.26.124:41085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:19.191084 9589 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:16:19.191431 9589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:19.191542 9589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:19.191663 9589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:19.199229 9589 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:19.199350 9589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:19.199414 9589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:19.199546 9589 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:19.199631 9589 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:19.209995 9589 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:43869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:37649,127.4.26.125:37259,127.4.26.124:41085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:19.211440 9589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:19.212878 9589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:19.225409 9596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:19.225375 9601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:19.225457 9598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:19.226632 9589 server_base.cc:1034] running on GCE node
I20260812 11:16:19.227502 9589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:19.229017 9589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:19.230274 9589 hybrid_clock.cc:648] HybridClock initialized: now 1786533379230200 us; error 49 us; skew 500 ppm
I20260812 11:16:19.230640 9589 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:19 dist-test-slave-rmhg krb5kdc[9566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533379, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:19.240875 9589 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:16:19.242624 9589 webserver.cc:460] Webserver started at http://127.4.26.126:36735/ using document root <none> and password file <none>
I20260812 11:16:19.243320 9589 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:19.243414 9589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:19.243710 9589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:19.246922 9589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "7b0e13ef1bb34e4aa3992264b9308bbc"
format_stamp: "Formatted at 2026-08-12 11:16:19 on dist-test-slave-rmhg"
server_key: "ceaa0bf455f743c9db2c5de9c1a4cad7"
server_key_iv: "7dc13ab5c12292702db98a29725ef02d"
server_key_version: "encryptionkey@0"
I20260812 11:16:19.247704 9589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "7b0e13ef1bb34e4aa3992264b9308bbc"
format_stamp: "Formatted at 2026-08-12 11:16:19 on dist-test-slave-rmhg"
server_key: "ceaa0bf455f743c9db2c5de9c1a4cad7"
server_key_iv: "7dc13ab5c12292702db98a29725ef02d"
server_key_version: "encryptionkey@0"
I20260812 11:16:19.253125 9589 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260812 11:16:19.256709 9610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:19.258142 9589 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260812 11:16:19.258292 9589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "7b0e13ef1bb34e4aa3992264b9308bbc"
format_stamp: "Formatted at 2026-08-12 11:16:19 on dist-test-slave-rmhg"
server_key: "ceaa0bf455f743c9db2c5de9c1a4cad7"
server_key_iv: "7dc13ab5c12292702db98a29725ef02d"
server_key_version: "encryptionkey@0"
I20260812 11:16:19.258484 9589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:19.283087 9589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:19.287856 9589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:19.288116 9589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:19.306917 9589 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:37649
I20260812 11:16:19.306926 9700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:37649 every 8 connection(s)
I20260812 11:16:19.308331 9589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:16:19.312288 9704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:19.312480 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 9589
I20260812 11:16:19.312711 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:16:19.313581 4201 external_mini_cluster.cc:1428] Setting key e48021de7fdd69e3f10677c3eb8ee0fd
I20260812 11:16:19.321969 9704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:16:19 dist-test-slave-rmhg krb5kdc[9566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533379, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.26.125@KRBTEST.COM; defaulting to no policy
I20260812 11:16:19.352468 9714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.326435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49362 (local address 127.4.26.126:37649)
0812 11:16:19.330282 (+ 3847us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:19.330288 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:19.330335 (+ 47us) server_negotiation.cc:407] Connection header received
0812 11:16:19.332590 (+ 2255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:19.332600 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:19.333072 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:19.333354 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:19.334722 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:19.336662 (+ 1940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:19.338500 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:19.339488 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:19.339694 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:19.343482 (+ 3788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:19.343494 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:19.343514 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:19.343553 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:19.347533 (+ 3980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:19.348455 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:19.348467 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:19.348470 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:19.348697 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:19.349257 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:19.349264 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:19.349267 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:19.350079 (+ 812us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:19.350333 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:19.350982 (+ 649us) server_negotiation.cc:299] Negotiation successful
0812 11:16:19.351269 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3651,"spinlock_wait_cycles":56576,"thread_start_us":2693,"threads_started":1}
I20260812 11:16:19.352494 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.326435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37649 (local address 127.0.0.1:49362)
0812 11:16:19.329780 (+ 3345us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.329854 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:19.332054 (+ 2200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:19.333401 (+ 1347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:19.333407 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:19.334073 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:19.334460 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:19.334482 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:19.336898 (+ 2416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:19.336904 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:19.338260 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:19.338278 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:19.339803 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:19.339810 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:19.339952 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:19.340689 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:19.340716 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:19.343178 (+ 2462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:19.347748 (+ 4570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:19.347763 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:19.347775 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:19.348258 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:19.348853 (+ 595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:19.348857 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:19.348859 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:19.349083 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:19.350286 (+ 1203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:19.350296 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:19.350545 (+ 249us) client_negotiation.cc:769] Sending connection context
0812 11:16:19.350786 (+ 241us) client_negotiation.cc:240] Negotiation successful
0812 11:16:19.351442 (+ 656us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2983,"mutex_wait_us":172,"thread_start_us":2691,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.125@KRBTEST.COM" created.
I20260812 11:16:19.355911 9704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:16:19.357081 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.356639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:37259 (local address 127.0.0.1:49446)
0812 11:16:19.356815 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.356931 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:37259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260812 11:16:19.357376 9611 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.26.125:37259: connect: Connection refused (error 111)
I20260812 11:16:19.359061 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.358649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:37259 (local address 127.0.0.1:49456)
0812 11:16:19.358822 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.358899 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:37259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260812 11:16:19.359256 9704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.125:37259: Network error: Client connection negotiation failed: client connection to 127.4.26.125:37259: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.125.keytab.
Entry for principal kudu/127.4.26.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.125.keytab.
I20260812 11:16:19.392493 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.125:37259
--webserver_interface=127.4.26.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.125.keytab
--principal=kudu/127.4.26.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:43869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:37649,127.4.26.125:37259,127.4.26.124:41085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:16:19.408615 9704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } attempt: 1
I20260812 11:16:19.409996 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.409425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:37259 (local address 127.0.0.1:49460)
0812 11:16:19.409645 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.409785 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:37259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 11:16:19.411088 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.410653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:37259 (local address 127.0.0.1:49474)
0812 11:16:19.410850 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.410943 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:37259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 11:16:19.411310 9704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.125:37259: Network error: Client connection negotiation failed: client connection to 127.4.26.125:37259: connect: Connection refused (error 111)
I20260812 11:16:19.479578 9704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } attempt: 2
I20260812 11:16:19.480955 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.480344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:37259 (local address 127.0.0.1:49490)
0812 11:16:19.480609 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.480740 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:37259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260812 11:16:19.482278 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.481777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:37259 (local address 127.0.0.1:49502)
0812 11:16:19.481955 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.482079 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:37259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 11:16:19.482553 9704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.125:37259: Network error: Client connection negotiation failed: client connection to 127.4.26.125:37259: connect: Connection refused (error 111)
I20260812 11:16:19.573856 9704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } attempt: 3
I20260812 11:16:19.575201 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.574638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:37259 (local address 127.0.0.1:49514)
0812 11:16:19.574880 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.575002 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:37259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 11:16:19.576335 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.575907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:37259 (local address 127.0.0.1:49530)
0812 11:16:19.576055 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.576158 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:37259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260812 11:16:19.576530 9704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.125:37259: Network error: Client connection negotiation failed: client connection to 127.4.26.125:37259: connect: Connection refused (error 111)
I20260812 11:16:19.719818 9704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } attempt: 4
I20260812 11:16:19.721343 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.720573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:37259 (local address 127.0.0.1:52958)
0812 11:16:19.720980 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.721105 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:37259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205}
I20260812 11:16:19.723587 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.723048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:37259 (local address 127.0.0.1:52966)
0812 11:16:19.723235 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.723373 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:37259: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260812 11:16:19.723853 9704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.125:37259: Network error: Client connection negotiation failed: client connection to 127.4.26.125:37259: connect: Connection refused (error 111)
W20260812 11:16:19.752156 9720 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:16:19.752516 9720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:19.752588 9720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:19.752684 9720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:19.760341 9720 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:19.760461 9720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:19.760519 9720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:19.760572 9720 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:19.760640 9720 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:19.771112 9720 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:43869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:37649,127.4.26.125:37259,127.4.26.124:41085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.125.keytab
--principal=kudu/127.4.26.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.125:37259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.26.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:19.772471 9720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:19.774001 9720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:19.786847 9727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:19.786975 9729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:19.786887 9733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:19.788846 9720 server_base.cc:1034] running on GCE node
I20260812 11:16:19.789849 9720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:19.791478 9720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:19.792742 9720 hybrid_clock.cc:648] HybridClock initialized: now 1786533379792650 us; error 68 us; skew 500 ppm
I20260812 11:16:19.793118 9720 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:19 dist-test-slave-rmhg krb5kdc[9566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533379, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:19.796782 9720 init.cc:377] Logged in from keytab as kudu/127.4.26.125@KRBTEST.COM (short username kudu)
I20260812 11:16:19.798585 9720 webserver.cc:460] Webserver started at http://127.4.26.125:45875/ using document root <none> and password file <none>
I20260812 11:16:19.799386 9720 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:19.799496 9720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:19.799834 9720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:19.803160 9720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/data/instance:
uuid: "cf588fd7db4e4fb4afeedd46e043a580"
format_stamp: "Formatted at 2026-08-12 11:16:19 on dist-test-slave-rmhg"
server_key: "7d7caf45ce48977407402b42ccf6e783"
server_key_iv: "96bc30d435cbff2b1fff2f4bd31294f0"
server_key_version: "encryptionkey@0"
I20260812 11:16:19.804069 9720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/wal/instance:
uuid: "cf588fd7db4e4fb4afeedd46e043a580"
format_stamp: "Formatted at 2026-08-12 11:16:19 on dist-test-slave-rmhg"
server_key: "7d7caf45ce48977407402b42ccf6e783"
server_key_iv: "96bc30d435cbff2b1fff2f4bd31294f0"
server_key_version: "encryptionkey@0"
I20260812 11:16:19.810125 9720 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 11:16:19.814141 9745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:19.815816 9720 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:16:19.816033 9720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/wal
uuid: "cf588fd7db4e4fb4afeedd46e043a580"
format_stamp: "Formatted at 2026-08-12 11:16:19 on dist-test-slave-rmhg"
server_key: "7d7caf45ce48977407402b42ccf6e783"
server_key_iv: "96bc30d435cbff2b1fff2f4bd31294f0"
server_key_version: "encryptionkey@0"
I20260812 11:16:19.816278 9720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:19.830394 9720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:19.835079 9720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:19.835368 9720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:19.854244 9720 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.125:37259
I20260812 11:16:19.854285 9823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.125:37259 every 8 connection(s)
I20260812 11:16:19.855759 9720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/data/info.pb
I20260812 11:16:19.858144 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 9720
I20260812 11:16:19.858328 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-1/wal/instance
I20260812 11:16:19.858763 4201 external_mini_cluster.cc:1428] Setting key 5756856fe462bd5e2d6a0168e6dccda9
I20260812 11:16:19.859936 9826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:19.867091 9826 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:16:19 dist-test-slave-rmhg krb5kdc[9566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533379, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.125@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:16:19.890995 9829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.870036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54420 (local address 127.4.26.126:37649)
0812 11:16:19.870545 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:19.870549 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:19.871840 (+ 1291us) server_negotiation.cc:407] Connection header received
0812 11:16:19.874479 (+ 2639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:19.874485 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:19.874577 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:19.874681 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:19.876475 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:19.877291 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:19.878950 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:19.879389 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:19.879513 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:19.883828 (+ 4315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:19.883836 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:19.883841 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:19.883902 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:19.887497 (+ 3595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:19.888402 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:19.888408 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:19.888412 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:19.888584 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:19.888997 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:19.889002 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:19.889005 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:19.889433 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:19.889611 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:19.890350 (+ 739us) server_negotiation.cc:299] Negotiation successful
0812 11:16:19.890597 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":268,"threads_started":1}
WARNING: no policy specified for kudu/127.4.26.124@KRBTEST.COM; defaulting to no policy
I20260812 11:16:19.891889 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.870744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37649 (local address 127.0.0.1:54420)
0812 11:16:19.871638 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.871691 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:19.874091 (+ 2400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:19.874973 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:19.874982 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:19.875568 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:19.876225 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:19.876246 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:19.877471 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:19.877475 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:19.878773 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:19.878789 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:19.879691 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:19.879700 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:19.879935 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:19.880824 (+ 889us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:19.880850 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:19.883499 (+ 2649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:19.887686 (+ 4187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:19.887696 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:19.887713 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:19.888252 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:19.888695 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:19.888699 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:19.888701 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:19.888890 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:19.889570 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:19.889576 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:19.889945 (+ 369us) client_negotiation.cc:769] Sending connection context
0812 11:16:19.890212 (+ 267us) client_negotiation.cc:240] Negotiation successful
0812 11:16:19.890656 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":385,"threads_started":1}
I20260812 11:16:19.893909 9826 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.124@KRBTEST.COM" created.
Aug 12 11:16:19 dist-test-slave-rmhg krb5kdc[9566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533379, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.125@KRBTEST.COM for kudu/127.4.26.125@KRBTEST.COM
I20260812 11:16:19.911970 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.894837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:37259 (local address 127.0.0.1:52974)
0812 11:16:19.895088 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.895109 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:19.895237 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:19.896359 (+ 1122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:19.896362 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:19.896784 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:19.896942 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:19.896961 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:19.899233 (+ 2272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:19.899238 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:19.900227 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:19.900246 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:19.901565 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:19.901574 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:19.901730 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:19.902373 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:19.902391 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:19.904883 (+ 2492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:19.909030 (+ 4147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:19.909034 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:19.909038 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:19.909487 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:19.909920 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:19.909924 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:19.909926 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:19.910074 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:19.910875 (+ 801us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:19.910881 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:19.911052 (+ 171us) client_negotiation.cc:769] Sending connection context
0812 11:16:19.911209 (+ 157us) client_negotiation.cc:240] Negotiation successful
0812 11:16:19.911520 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260812 11:16:19.911998 9834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.895048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52974 (local address 127.4.26.125:37259)
0812 11:16:19.895787 (+ 739us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:19.895795 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:19.895828 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:16:19.895889 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:19.895896 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:19.896185 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:19.896353 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:19.897135 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:19.898983 (+ 1848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:19.900412 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:19.901334 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:19.901484 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:19.905221 (+ 3737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:19.905242 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:19.905266 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:19.905307 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:19.908847 (+ 3540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:19.909647 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:19.909657 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:19.909660 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:19.909806 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:19.910180 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:19.910184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:19.910188 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:19.910667 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:19.910837 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:19.911375 (+ 538us) server_negotiation.cc:299] Negotiation successful
0812 11:16:19.911655 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":565,"thread_start_us":398,"threads_started":1}
I20260812 11:16:19.914769 9826 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:16:19.916097 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.915562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43168)
0812 11:16:19.915767 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.915917 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260812 11:16:19.916373 9750 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
I20260812 11:16:19.918033 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.917649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43170)
0812 11:16:19.917808 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.917902 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 11:16:19.918241 9826 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:41085: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.124.keytab.
Entry for principal kudu/127.4.26.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.124.keytab.
I20260812 11:16:19.936685 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.124:41085
--webserver_interface=127.4.26.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.124.keytab
--principal=kudu/127.4.26.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:43869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:37649,127.4.26.125:37259,127.4.26.124:41085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:16:19.967600 9826 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } attempt: 1
I20260812 11:16:19.968989 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.968399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43180)
0812 11:16:19.968638 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.968779 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260812 11:16:19.970237 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:19.969796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43184)
0812 11:16:19.969957 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:19.970085 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260812 11:16:19.970489 9826 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:41085: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
I20260812 11:16:20.023131 9704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } attempt: 5
Aug 12 11:16:20 dist-test-slave-rmhg krb5kdc[9566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533379, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for kudu/127.4.26.125@KRBTEST.COM
I20260812 11:16:20.038267 9834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.024088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52978 (local address 127.4.26.125:37259)
0812 11:16:20.024250 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.024255 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.024276 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:16:20.024365 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.024369 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.024445 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.024525 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.025583 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.026319 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.028098 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.028569 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.028672 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.032488 (+ 3816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:20.032495 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:20.032498 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:20.032537 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:20.035241 (+ 2704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.036118 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.036124 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.036126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.036269 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.036748 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.036753 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.036755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.037107 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:20.037293 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:20.037833 (+ 540us) server_negotiation.cc:299] Negotiation successful
0812 11:16:20.038045 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260812 11:16:20.038326 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.023832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:37259 (local address 127.0.0.1:52978)
0812 11:16:20.024079 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.024101 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:20.024240 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:20.024596 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:20.024602 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:20.025131 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:20.025406 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:20.025419 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.026479 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.026485 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:20.027903 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:20.027933 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.028729 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.028735 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:20.028953 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.029634 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:20.029658 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:20.032236 (+ 2578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:20.035406 (+ 3170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:20.035412 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:20.035416 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:20.035948 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:20.036382 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:20.036387 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:20.036390 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:20.036564 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:20.037269 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:20.037275 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:20.037469 (+ 194us) client_negotiation.cc:769] Sending connection context
0812 11:16:20.037666 (+ 197us) client_negotiation.cc:240] Negotiation successful
0812 11:16:20.037976 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260812 11:16:20.038705 9826 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } attempt: 2
I20260812 11:16:20.039637 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.039226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43190)
0812 11:16:20.039385 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.039480 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 11:16:20.039711 9704 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:16:20.040760 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.040300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43200)
0812 11:16:20.040492 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.040589 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 11:16:20.041502 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.040586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43210)
0812 11:16:20.040793 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.041077 (+ 284us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260812 11:16:20.041700 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.041350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43226)
0812 11:16:20.041490 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.041575 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260812 11:16:20.041692 9826 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:41085: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
W20260812 11:16:20.041927 9704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:41085: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
I20260812 11:16:20.093199 9704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } attempt: 1
I20260812 11:16:20.094530 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.093926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43240)
0812 11:16:20.094181 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.094309 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260812 11:16:20.095701 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.095292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43254)
0812 11:16:20.095446 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.095542 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260812 11:16:20.095932 9704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:41085: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
I20260812 11:16:20.132912 9826 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } attempt: 3
I20260812 11:16:20.134116 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.133621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43264)
0812 11:16:20.133851 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.133952 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260812 11:16:20.135540 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.134995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43272)
0812 11:16:20.135278 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.135364 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169}
W20260812 11:16:20.135780 9826 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:41085: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
I20260812 11:16:20.164180 9704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } attempt: 2
I20260812 11:16:20.165616 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.164946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43280)
0812 11:16:20.165248 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.165376 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260812 11:16:20.166869 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.166417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43284)
0812 11:16:20.166601 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.166710 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260812 11:16:20.167176 9704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:41085: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
I20260812 11:16:20.273454 9704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } attempt: 3
I20260812 11:16:20.274813 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.274195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43290)
0812 11:16:20.274465 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.274585 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260812 11:16:20.276074 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.275562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43296)
0812 11:16:20.275813 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.275912 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
W20260812 11:16:20.276337 9704 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:41085: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
I20260812 11:16:20.279034 9826 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } attempt: 4
I20260812 11:16:20.280194 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.279711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43302)
0812 11:16:20.279935 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.280030 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260812 11:16:20.281472 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.281011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43306)
0812 11:16:20.281248 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.281335 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260812 11:16:20.281714 9826 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:41085: Network error: Client connection negotiation failed: client connection to 127.4.26.124:41085: connect: Connection refused (error 111)
W20260812 11:16:20.297899 9841 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:16:20.298265 9841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:20.298339 9841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:20.298426 9841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:20.306103 9841 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:20.306241 9841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:20.306326 9841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:20.306391 9841 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:20.306515 9841 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:20.317868 9841 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:43869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:37649,127.4.26.125:37259,127.4.26.124:41085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.124.keytab
--principal=kudu/127.4.26.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.124:41085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.26.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:20.319303 9841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:20.320794 9841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:20.333377 9846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:20.333256 9848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:20.333226 9852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:20.334583 9841 server_base.cc:1034] running on GCE node
I20260812 11:16:20.335505 9841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:20.337085 9841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:20.338397 9841 hybrid_clock.cc:648] HybridClock initialized: now 1786533380338312 us; error 53 us; skew 500 ppm
I20260812 11:16:20.338825 9841 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:20 dist-test-slave-rmhg krb5kdc[9566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533380, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:20.342252 9841 init.cc:377] Logged in from keytab as kudu/127.4.26.124@KRBTEST.COM (short username kudu)
I20260812 11:16:20.343807 9841 webserver.cc:460] Webserver started at http://127.4.26.124:39821/ using document root <none> and password file <none>
I20260812 11:16:20.344575 9841 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:20.344688 9841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:20.345007 9841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:20.348325 9841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/data/instance:
uuid: "dd6ca929846a42c08de368cff767d541"
format_stamp: "Formatted at 2026-08-12 11:16:20 on dist-test-slave-rmhg"
server_key: "26ec49306c6d6aa94cd0ee0c5d28a113"
server_key_iv: "f7cd1ab3419ab65abdf6d1f6339da93a"
server_key_version: "encryptionkey@0"
I20260812 11:16:20.349337 9841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/wal/instance:
uuid: "dd6ca929846a42c08de368cff767d541"
format_stamp: "Formatted at 2026-08-12 11:16:20 on dist-test-slave-rmhg"
server_key: "26ec49306c6d6aa94cd0ee0c5d28a113"
server_key_iv: "f7cd1ab3419ab65abdf6d1f6339da93a"
server_key_version: "encryptionkey@0"
I20260812 11:16:20.354967 9841 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260812 11:16:20.358942 9867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:20.360599 9841 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260812 11:16:20.360805 9841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/wal
uuid: "dd6ca929846a42c08de368cff767d541"
format_stamp: "Formatted at 2026-08-12 11:16:20 on dist-test-slave-rmhg"
server_key: "26ec49306c6d6aa94cd0ee0c5d28a113"
server_key_iv: "f7cd1ab3419ab65abdf6d1f6339da93a"
server_key_version: "encryptionkey@0"
I20260812 11:16:20.361035 9841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:20.375950 9841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:20.382045 9841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:20.382354 9841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:20.400964 9841 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.124:41085
I20260812 11:16:20.401000 9952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.124:41085 every 8 connection(s)
I20260812 11:16:20.402429 9841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/data/info.pb
I20260812 11:16:20.406577 9953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:20.411860 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 9841
I20260812 11:16:20.412075 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786532997575371-4201-0/minicluster-data/master-2/wal/instance
I20260812 11:16:20.412593 4201 external_mini_cluster.cc:1428] Setting key 0cc6631a4647408366fac42677028b39
I20260812 11:16:20.414289 9953 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:16:20 dist-test-slave-rmhg krb5kdc[9566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533380, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.124@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
Aug 12 11:16:20 dist-test-slave-rmhg krb5kdc[9566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533378, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.124@KRBTEST.COM
I20260812 11:16:20.431978 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.416906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54426 (local address 127.4.26.126:37649)
0812 11:16:20.417386 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.417391 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.417923 (+ 532us) server_negotiation.cc:407] Connection header received
0812 11:16:20.418160 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.418164 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.418224 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.418318 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.419577 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.420300 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.421893 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.422297 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.422417 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.426013 (+ 3596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:20.426018 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:20.426021 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:20.426063 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:20.428875 (+ 2812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.429704 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.429710 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.429713 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.429841 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.430251 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.430255 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.430257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.430520 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:20.430664 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:20.431367 (+ 703us) server_negotiation.cc:299] Negotiation successful
0812 11:16:20.431588 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":253,"threads_started":1}
I20260812 11:16:20.433342 9956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.414592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43308 (local address 127.4.26.124:41085)
0812 11:16:20.415416 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.415428 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.415472 (+ 44us) server_negotiation.cc:407] Connection header received
0812 11:16:20.417357 (+ 1885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.417387 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.417806 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.418139 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.419537 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.420799 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.422314 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.423007 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.423160 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.427340 (+ 4180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:20.427348 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:20.427362 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:20.427391 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:20.430060 (+ 2669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.430721 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.430728 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.430730 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.430853 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.431225 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.431229 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.431231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.431586 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:20.431886 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:20.432182 (+ 296us) server_negotiation.cc:299] Negotiation successful
0812 11:16:20.432415 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":618,"thread_start_us":364,"threads_started":1}
I20260812 11:16:20.433377 9958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.416904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37649 (local address 127.0.0.1:54426)
0812 11:16:20.417759 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.417801 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:20.417985 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:20.418420 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:20.418426 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:20.419018 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:20.419414 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:20.419432 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.420488 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.420492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:20.421744 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:20.421756 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.422521 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.422533 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:20.422796 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.423526 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:20.423550 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:20.425808 (+ 2258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:20.429006 (+ 3198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:20.429019 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:20.429032 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:20.429579 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:20.429952 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:20.429957 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:20.429961 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:20.430134 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:20.430648 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:20.430657 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:20.430997 (+ 340us) client_negotiation.cc:769] Sending connection context
0812 11:16:20.431235 (+ 238us) client_negotiation.cc:240] Negotiation successful
0812 11:16:20.431752 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"mutex_wait_us":42,"thread_start_us":479,"threads_started":1}
I20260812 11:16:20.435014 9953 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:16:20 dist-test-slave-rmhg krb5kdc[9566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533380, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.124@KRBTEST.COM for kudu/127.4.26.125@KRBTEST.COM
Aug 12 11:16:20 dist-test-slave-rmhg krb5kdc[9566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533378, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:16:20.449592 9958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.435734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:37259 (local address 127.0.0.1:52982)
0812 11:16:20.435892 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.435908 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:20.435989 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:20.436291 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:20.436295 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:20.436822 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:20.436972 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:20.436981 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.438028 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.438032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:20.438923 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:20.438934 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.439617 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.439623 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:20.439820 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.440418 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:20.440442 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:20.442935 (+ 2493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:20.446785 (+ 3850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:20.446792 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:20.446796 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:20.447347 (+ 551us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:20.447841 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:20.447845 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:20.447847 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:20.447998 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:20.448570 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:20.448575 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:20.448726 (+ 151us) client_negotiation.cc:769] Sending connection context
0812 11:16:20.448851 (+ 125us) client_negotiation.cc:240] Negotiation successful
0812 11:16:20.449233 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 11:16:20.449632 9834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.435741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52982 (local address 127.4.26.125:37259)
0812 11:16:20.435939 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.435946 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.435979 (+ 33us) server_negotiation.cc:407] Connection header received
0812 11:16:20.436089 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.436094 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.436176 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.436280 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.437123 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.437879 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.439068 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.439480 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.439593 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.443177 (+ 3584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:20.443182 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:20.443186 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:20.443229 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:20.446367 (+ 3138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.447503 (+ 1136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.447508 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.447511 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.447693 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.448117 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.448122 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.448126 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.448442 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:20.448581 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:20.448968 (+ 387us) server_negotiation.cc:299] Negotiation successful
0812 11:16:20.449222 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:16:20.450860 9953 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:16:20.451835 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.436627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54438 (local address 127.4.26.126:37649)
0812 11:16:20.436795 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.436800 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.436840 (+ 40us) server_negotiation.cc:407] Connection header received
0812 11:16:20.437026 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.437031 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.437103 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.437205 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.438382 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.439076 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.440283 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.440994 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.441126 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.445894 (+ 4768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:20.445899 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:20.445903 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:20.445939 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:20.448863 (+ 2924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.449669 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.449675 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.449677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.449856 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.450282 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.450286 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.450288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.450635 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:20.450913 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:20.451254 (+ 341us) server_negotiation.cc:299] Negotiation successful
0812 11:16:20.451550 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260812 11:16:20.453544 9704 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } attempt: 4
Aug 12 11:16:20 dist-test-slave-rmhg krb5kdc[9566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533380, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.124@KRBTEST.COM for kudu/127.4.26.124@KRBTEST.COM
Aug 12 11:16:20 dist-test-slave-rmhg krb5kdc[9566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533379, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for kudu/127.4.26.124@KRBTEST.COM
Aug 12 11:16:20 dist-test-slave-rmhg krb5kdc[9566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533378, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.125@KRBTEST.COM
I20260812 11:16:20.467331 9958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.451578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43310)
0812 11:16:20.451917 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.451938 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:20.452033 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:20.452727 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:20.452732 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:20.453141 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:20.453355 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:20.453368 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.454660 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.454665 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:20.455893 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:20.455904 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.456709 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.456715 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:20.456917 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.457577 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:20.457601 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:20.459969 (+ 2368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:20.463677 (+ 3708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:20.463683 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:20.463687 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:20.464264 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:20.465280 (+ 1016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:20.465287 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:20.465289 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:20.465441 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:20.466164 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:20.466168 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:20.466336 (+ 168us) client_negotiation.cc:769] Sending connection context
0812 11:16:20.466516 (+ 180us) client_negotiation.cc:240] Negotiation successful
0812 11:16:20.466881 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225}
I20260812 11:16:20.467720 9956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.451811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43310 (local address 127.4.26.124:41085)
0812 11:16:20.452014 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.452020 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.452037 (+ 17us) server_negotiation.cc:407] Connection header received
0812 11:16:20.452137 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.452142 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.452214 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.452306 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.453484 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.454521 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.456058 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.456560 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.456687 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.460176 (+ 3489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:20.460182 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:20.460187 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:20.460221 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:20.463503 (+ 3282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.464415 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.464421 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.464425 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.464645 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.465596 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.465601 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.465605 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.465937 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:20.466117 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:20.466635 (+ 518us) server_negotiation.cc:299] Negotiation successful
0812 11:16:20.467075 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":182,"server-negotiator.queue_time_us":58}
I20260812 11:16:20.471047 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.454098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43312)
0812 11:16:20.454311 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.454326 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:20.454412 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:20.455376 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:20.455382 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:20.455834 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:20.456039 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:20.456052 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.457667 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.457673 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:20.459068 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:20.459084 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.459884 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.459891 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:20.460078 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.460905 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:20.460924 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:20.463867 (+ 2943us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:20.468070 (+ 4203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:20.468077 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:20.468081 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:20.468635 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:20.469073 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:20.469078 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:20.469081 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:20.469309 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:20.470009 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:20.470014 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:20.470208 (+ 194us) client_negotiation.cc:769] Sending connection context
0812 11:16:20.470338 (+ 130us) client_negotiation.cc:240] Negotiation successful
0812 11:16:20.470666 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115}
I20260812 11:16:20.472292 9959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.454297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43312 (local address 127.4.26.124:41085)
0812 11:16:20.455065 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.455070 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.455091 (+ 21us) server_negotiation.cc:407] Connection header received
0812 11:16:20.455131 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.455136 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.455198 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.455304 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.456205 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.457517 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.459276 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.459723 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.459837 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.464140 (+ 4303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:20.464148 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:20.464152 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:20.464192 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:20.467911 (+ 3719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.468788 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.468793 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.468796 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.468951 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.469451 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.469456 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.469459 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.469856 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:20.471481 (+ 1625us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:20.471623 (+ 142us) server_negotiation.cc:299] Negotiation successful
0812 11:16:20.471862 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":408,"threads_started":1}
I20260812 11:16:20.472355 9834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.453565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52996 (local address 127.4.26.125:37259)
0812 11:16:20.453730 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.453735 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.454028 (+ 293us) server_negotiation.cc:407] Connection header received
0812 11:16:20.454276 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.454281 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.454359 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.454431 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.456024 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.457126 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.458952 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.459655 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.459797 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.464896 (+ 5099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:20.464904 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:20.464909 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:20.464970 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:20.468458 (+ 3488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.469407 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.469414 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.469418 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.469707 (+ 289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.470448 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.470453 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.470456 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.470765 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:20.471040 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:20.471925 (+ 885us) server_negotiation.cc:299] Negotiation successful
0812 11:16:20.472122 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260812 11:16:20.474402 9953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541: Bootstrap starting.
I20260812 11:16:20.477210 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:16:20.478295 9704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc: Bootstrap starting.
I20260812 11:16:20.478711 9953 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:20.480168 9953 log.cc:824] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:20.482730 9704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:20.479988 9658 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54438
I20260812 11:16:20.484012 9953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541: No bootstrap required, opened a new log
I20260812 11:16:20.484220 9704 log.cc:824] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:20.487838 9704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc: No bootstrap required, opened a new log
I20260812 11:16:20.494807 9953 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } }
I20260812 11:16:20.495321 9953 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd6ca929846a42c08de368cff767d541, State: Initialized, Role: FOLLOWER
I20260812 11:16:20.495447 9704 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } }
I20260812 11:16:20.495852 9704 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b0e13ef1bb34e4aa3992264b9308bbc, State: Initialized, Role: FOLLOWER
I20260812 11:16:20.495895 9953 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } }
I20260812 11:16:20.496331 9704 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } }
I20260812 11:16:20.496971 9965 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } } }
I20260812 11:16:20.497430 9965 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:16:20.497756 9967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } } }
I20260812 11:16:20.498199 9967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:16:20.498422 9953 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:16:20.498564 9704 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:16:20.498761 9658 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 11:16:20.498942 9658 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:20.501425 9658 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } }
I20260812 11:16:20.502884 9658 leader_election.cc:288] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [CANDIDATE]: Term 1 election: Requested vote from peers cf588fd7db4e4fb4afeedd46e043a580 (127.4.26.125:37259), dd6ca929846a42c08de368cff767d541 (127.4.26.124:41085)
I20260812 11:16:20.503650 9911 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "dd6ca929846a42c08de368cff767d541"
I20260812 11:16:20.504208 9911 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:20.508153 9911 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b0e13ef1bb34e4aa3992264b9308bbc in term 1.
I20260812 11:16:20.509043 9614 leader_election.cc:302] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b0e13ef1bb34e4aa3992264b9308bbc, dd6ca929846a42c08de368cff767d541; no voters:
I20260812 11:16:20.509748 9967 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:20.524264 9967 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [term 1 LEADER]: Becoming Leader. State: Replica: 7b0e13ef1bb34e4aa3992264b9308bbc, State: Running, Role: LEADER
I20260812 11:16:20.525918 9967 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } }
W20260812 11:16:20.541296 9619 tablet.cc:2369] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:16:20.555707 10018 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 11:16:20.559365 9841 master_runner.cc:186] Error getting master registration for 127.4.26.126:37649: OK, instance_id { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" instance_seqno: 1786533379301678 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:16:20.569891 9841 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:16:20.573084 9959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.534560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43326 (local address 127.4.26.124:41085)
0812 11:16:20.534819 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.534827 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.545392 (+ 10565us) server_negotiation.cc:407] Connection header received
0812 11:16:20.546225 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.546232 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.546355 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.546436 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.549931 (+ 3495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.551049 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.557857 (+ 6808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.558490 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.558610 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.564048 (+ 5438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:20.564056 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:20.564063 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:20.564117 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:20.568633 (+ 4516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.570195 (+ 1562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.570202 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.570205 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.570392 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.570974 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.570979 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.570983 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.571582 (+ 599us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:20.571840 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:20.572471 (+ 631us) server_negotiation.cc:299] Negotiation successful
0812 11:16:20.572738 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260812 11:16:20.573544 9981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b0e13ef1bb34e4aa3992264b9308bbc. Latest consensus state: current_term: 1 leader_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } } }
I20260812 11:16:20.574033 9981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:20.575001 10021 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:16:20.578532 9957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.538472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54442 (local address 127.4.26.126:37649)
0812 11:16:20.538692 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.538700 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.550780 (+ 12080us) server_negotiation.cc:407] Connection header received
0812 11:16:20.551211 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.551217 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.551304 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.551378 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.561510 (+ 10132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.562702 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.564874 (+ 2172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.565548 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.565675 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.569196 (+ 3521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:20.569205 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:20.569210 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:20.569260 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:20.573285 (+ 4025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.575057 (+ 1772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.575064 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.575068 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.575285 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.576106 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.576113 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.576117 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.576579 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:20.576884 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:20.577787 (+ 903us) server_negotiation.cc:299] Negotiation successful
0812 11:16:20.578128 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260812 11:16:20.580953 9834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.535276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53012 (local address 127.4.26.125:37259)
0812 11:16:20.535592 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.535599 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.544751 (+ 9152us) server_negotiation.cc:407] Connection header received
0812 11:16:20.549325 (+ 4574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.549333 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.549435 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.549524 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.553392 (+ 3868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.554532 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.557054 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.557723 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.557830 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.564053 (+ 6223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:20.564060 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:20.564064 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:20.564117 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:20.568126 (+ 4009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.577793 (+ 9667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.577801 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.577805 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.578033 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.578876 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.578883 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.578886 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.579361 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:20.579648 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:20.580290 (+ 642us) server_negotiation.cc:299] Negotiation successful
0812 11:16:20.580592 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260812 11:16:20.580935 9826 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } attempt: 5
I20260812 11:16:20.588114 10021 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 12 11:16:20 dist-test-slave-rmhg krb5kdc[9566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533379, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.125@KRBTEST.COM for kudu/127.4.26.124@KRBTEST.COM
I20260812 11:16:20.582957 9589 master_runner.cc:186] Error getting master registration for 127.4.26.125:37259: OK, instance_id { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" instance_seqno: 1786533379848744 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:16:20.599210 9589 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 11:16:20.600401 9959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.581932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43338 (local address 127.4.26.124:41085)
0812 11:16:20.582156 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.582161 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.582179 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:16:20.582233 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.582238 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.582315 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.582418 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.583427 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.584700 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.586545 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.587214 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.587353 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.591903 (+ 4550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:20.591910 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:20.591915 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:20.591966 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:20.596248 (+ 4282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.597334 (+ 1086us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.597340 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.597344 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.597533 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:20.598081 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:20.598095 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:20.598099 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:20.598491 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:20.598681 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:20.599796 (+ 1115us) server_negotiation.cc:299] Negotiation successful
0812 11:16:20.600052 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260812 11:16:20.600924 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:20.581541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:41085 (local address 127.0.0.1:43338)
0812 11:16:20.581786 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:20.581808 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:20.581910 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:20.582465 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:20.582470 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:20.583019 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:20.583244 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:20.583258 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.584900 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.584909 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:20.586343 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:20.586361 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:20.587484 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:20.587494 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:20.587921 (+ 427us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:20.588651 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:20.588675 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:20.591641 (+ 2966us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:20.596477 (+ 4836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:20.596484 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:20.596488 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:20.597088 (+ 600us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:20.597688 (+ 600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:20.597694 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:20.597698 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:20.597882 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:20.598757 (+ 875us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:20.598762 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:20.598958 (+ 196us) client_negotiation.cc:769] Sending connection context
0812 11:16:20.599113 (+ 155us) client_negotiation.cc:240] Negotiation successful
0812 11:16:20.599459 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135}
I20260812 11:16:20.607988 9826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580: Bootstrap starting.
I20260812 11:16:20.612561 9826 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:20.614161 9826 log.cc:824] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:20.618774 9826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580: No bootstrap required, opened a new log
I20260812 11:16:20.618784 9911 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541 [term 1 FOLLOWER]: Refusing update from remote peer 7b0e13ef1bb34e4aa3992264b9308bbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:20.620424 9981 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:20.629822 9826 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } }
I20260812 11:16:20.630450 9826 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf588fd7db4e4fb4afeedd46e043a580, State: Initialized, Role: FOLLOWER
I20260812 11:16:20.631083 9826 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } }
W20260812 11:16:20.634617 9874 tablet.cc:2369] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:16:20.635916 9965 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b0e13ef1bb34e4aa3992264b9308bbc. Latest consensus state: current_term: 1 leader_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } } }
I20260812 11:16:20.636248 9965 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:16:20.639242 10035 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } } }
I20260812 11:16:20.639560 10026 mvcc.cc:205] Tried to move back new op lower bound from 7317640727002701824 to 7317640726655451136. Current Snapshot: MvccSnapshot[applied={T|T < 7317640727002701824}]
I20260812 11:16:20.641908 10035 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:16:20.641747 9826 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:16:20.642272 9779 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:20.646633 9779 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580 [term 1 FOLLOWER]: Refusing update from remote peer 7b0e13ef1bb34e4aa3992264b9308bbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:20.647424 9781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "cf588fd7db4e4fb4afeedd46e043a580"
I20260812 11:16:20.647960 9981 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:20.651461 9781 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b0e13ef1bb34e4aa3992264b9308bbc in term 1.
I20260812 11:16:20.660329 9981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } } }
I20260812 11:16:20.660645 9981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:20.668394 10021 catalog_manager.cc:1347] Generated new cluster ID: 74fbaf95948d4c62a94c3ce10c688ddc
I20260812 11:16:20.668522 10021 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:16:20.669766 9965 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } } }
I20260812 11:16:20.670063 9965 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:16:20.693001 10035 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b0e13ef1bb34e4aa3992264b9308bbc. Latest consensus state: current_term: 1 leader_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } } }
I20260812 11:16:20.693347 10021 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:16:20.693368 10035 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:16:20.693714 10051 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } } }
I20260812 11:16:20.694132 10051 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:16:20.695405 10021 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:16:20.695878 9981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b0e13ef1bb34e4aa3992264b9308bbc" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37649 } } peers { permanent_uuid: "cf588fd7db4e4fb4afeedd46e043a580" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 37259 } } peers { permanent_uuid: "dd6ca929846a42c08de368cff767d541" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 41085 } } }
I20260812 11:16:20.696131 9981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:20.711769 10021 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b0e13ef1bb34e4aa3992264b9308bbc: Generated new TSK 0
I20260812 11:16:20.713079 10021 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 11:16:20.713186 10066 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260812 11:16:20.807354 9959 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:20.802682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43346 (local address 127.4.26.124:41085)
0812 11:16:20.802856 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.802861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.804767 (+ 1906us) server_negotiation.cc:407] Connection header received
0812 11:16:20.805316 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.805324 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.805418 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.805495 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.807090 (+ 1595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43346: BlockingRecv error: recv got EOF from 127.0.0.1:43346 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260812 11:16:20.807775 9834 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:20.802895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53022 (local address 127.4.26.125:37259)
0812 11:16:20.803092 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.803098 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.805195 (+ 2097us) server_negotiation.cc:407] Connection header received
0812 11:16:20.805459 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.805466 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.805565 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.805635 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.807542 (+ 1907us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53022: BlockingRecv error: recv got EOF from 127.0.0.1:53022 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260812 11:16:20.808914 9957 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:20.802207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54456 (local address 127.4.26.126:37649)
0812 11:16:20.802452 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.802463 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.806743 (+ 4280us) server_negotiation.cc:407] Connection header received
0812 11:16:20.807154 (+ 411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.807160 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.807248 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.807325 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.808687 (+ 1362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54456: BlockingRecv error: recv got EOF from 127.0.0.1:54456 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260812 11:16:20.817229 9834 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:20.814948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53028 (local address 127.4.26.125:37259)
0812 11:16:20.815159 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.815165 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.815569 (+ 404us) server_negotiation.cc:407] Connection header received
0812 11:16:20.815779 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.815783 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.815898 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.815994 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.816906 (+ 912us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53028: BlockingRecv error: recv got EOF from 127.0.0.1:53028 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260812 11:16:20.825181 9834 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:20.823599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53036 (local address 127.4.26.125:37259)
0812 11:16:20.823802 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.823808 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.823831 (+ 23us) server_negotiation.cc:407] Connection header received
0812 11:16:20.823942 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.823946 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.824020 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.824111 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.824941 (+ 830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53036: BlockingRecv error: recv got EOF from 127.0.0.1:53036 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260812 11:16:20.833717 9834 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:20.831374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53048 (local address 127.4.26.125:37259)
0812 11:16:20.831587 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.831593 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.832004 (+ 411us) server_negotiation.cc:407] Connection header received
0812 11:16:20.832233 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.832237 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.832332 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.832428 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.833455 (+ 1027us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53048: BlockingRecv error: recv got EOF from 127.0.0.1:53048 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260812 11:16:20.844360 9834 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:20.841971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53056 (local address 127.4.26.125:37259)
0812 11:16:20.842218 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.842225 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.842807 (+ 582us) server_negotiation.cc:407] Connection header received
0812 11:16:20.843020 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.843025 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.843114 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.843195 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.844116 (+ 921us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53056: BlockingRecv error: recv got EOF from 127.0.0.1:53056 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260812 11:16:20.858683 9834 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:20.856295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53060 (local address 127.4.26.125:37259)
0812 11:16:20.856479 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.856485 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.857086 (+ 601us) server_negotiation.cc:407] Connection header received
0812 11:16:20.857354 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.857360 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.857472 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.857599 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.858439 (+ 840us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53060: BlockingRecv error: recv got EOF from 127.0.0.1:53060 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260812 11:16:20.881888 9834 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:20.879667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53074 (local address 127.4.26.125:37259)
0812 11:16:20.879875 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.879882 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.880294 (+ 412us) server_negotiation.cc:407] Connection header received
0812 11:16:20.880484 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.880491 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.880607 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.880735 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.881629 (+ 894us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53074: BlockingRecv error: recv got EOF from 127.0.0.1:53074 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260812 11:16:20.920351 9834 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:20.918019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53084 (local address 127.4.26.125:37259)
0812 11:16:20.918257 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.918263 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.918675 (+ 412us) server_negotiation.cc:407] Connection header received
0812 11:16:20.918888 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.918892 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.918973 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.919100 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.920002 (+ 902us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53084: BlockingRecv error: recv got EOF from 127.0.0.1:53084 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
W20260812 11:16:20.990613 9834 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:20.988541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53096 (local address 127.4.26.125:37259)
0812 11:16:20.988815 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:20.988822 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:20.989137 (+ 315us) server_negotiation.cc:407] Connection header received
0812 11:16:20.989363 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:20.989369 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:20.989471 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:20.989602 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:20.990392 (+ 790us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53096: BlockingRecv error: recv got EOF from 127.0.0.1:53096 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260812 11:16:21.125070 9834 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:21.122798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53112 (local address 127.4.26.125:37259)
0812 11:16:21.123033 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:21.123059 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:21.123454 (+ 395us) server_negotiation.cc:407] Connection header received
0812 11:16:21.123679 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:21.123684 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:21.123765 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:21.123858 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:21.124802 (+ 944us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53112: BlockingRecv error: recv got EOF from 127.0.0.1:53112 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260812 11:16:21.386952 9834 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:21.384942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53128 (local address 127.4.26.125:37259)
0812 11:16:21.385233 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:21.385240 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:21.385400 (+ 160us) server_negotiation.cc:407] Connection header received
0812 11:16:21.385644 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:21.385649 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:21.385726 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:21.385816 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:21.386723 (+ 907us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53128: BlockingRecv error: recv got EOF from 127.0.0.1:53128 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
I20260812 11:16:21.560694 10018 catalog_manager.cc:1259] Loaded cluster ID: 74fbaf95948d4c62a94c3ce10c688ddc
I20260812 11:16:21.560858 10018 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541: loading cluster ID for follower catalog manager: success
I20260812 11:16:21.563887 10018 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541: acquiring CA information for follower catalog manager: success
I20260812 11:16:21.566180 10018 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dd6ca929846a42c08de368cff767d541: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:16:21.718935 10066 catalog_manager.cc:1259] Loaded cluster ID: 74fbaf95948d4c62a94c3ce10c688ddc
I20260812 11:16:21.719110 10066 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580: loading cluster ID for follower catalog manager: success
I20260812 11:16:21.723867 10066 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580: acquiring CA information for follower catalog manager: success
I20260812 11:16:21.726886 10066 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cf588fd7db4e4fb4afeedd46e043a580: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:16:21.924655 10179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:21.907259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53138 (local address 127.4.26.125:37259)
0812 11:16:21.917656 (+ 10397us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:21.917664 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:21.918151 (+ 487us) server_negotiation.cc:407] Connection header received
0812 11:16:21.918389 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:21.918395 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:21.918606 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:21.918766 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:21.919297 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:21.920196 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:21.922159 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:21.922645 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:21.922751 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:21.923386 (+ 635us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:21.923957 (+ 571us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:21.924065 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:21.924213 (+ 148us) server_negotiation.cc:299] Negotiation successful
0812 11:16:21.924285 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10248,"thread_start_us":10077,"threads_started":1}
I20260812 11:16:21.938616 10190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:21.931110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43350 (local address 127.4.26.124:41085)
0812 11:16:21.932352 (+ 1242us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:21.932356 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:21.932372 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:16:21.932468 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:21.932472 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:21.932621 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:21.932762 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:21.933316 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:21.934095 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:21.936066 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:21.936542 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:21.936643 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:21.937309 (+ 666us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:21.937914 (+ 605us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:21.938026 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:21.938166 (+ 140us) server_negotiation.cc:299] Negotiation successful
0812 11:16:21.938242 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1138,"thread_start_us":999,"threads_started":1}
I20260812 11:16:21.969710 10190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:21.950722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43360 (local address 127.4.26.124:41085)
0812 11:16:21.953825 (+ 3103us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:21.953832 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:21.962244 (+ 8412us) server_negotiation.cc:407] Connection header received
0812 11:16:21.962349 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:21.962355 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:21.962454 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:21.962557 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:21.963365 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:21.964498 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:21.967078 (+ 2580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:21.967695 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:21.967797 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:21.968452 (+ 655us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:21.968589 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:21.968687 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:21.969293 (+ 606us) server_negotiation.cc:299] Negotiation successful
0812 11:16:21.969384 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2964}
I20260812 11:16:21.970041 10179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:21.950536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53144 (local address 127.4.26.125:37259)
0812 11:16:21.950976 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:21.950988 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:21.962290 (+ 11302us) server_negotiation.cc:407] Connection header received
0812 11:16:21.962494 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:21.962500 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:21.962596 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:21.962705 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:21.963685 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:21.964926 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:21.967502 (+ 2576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:21.968174 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:21.968272 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:21.969194 (+ 922us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:21.969332 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:21.969398 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:21.969623 (+ 225us) server_negotiation.cc:299] Negotiation successful
0812 11:16:21.969708 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271}
I20260812 11:16:21.970394 10198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:21.950416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54468 (local address 127.4.26.126:37649)
0812 11:16:21.962872 (+ 12456us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:21.962877 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:21.962896 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:16:21.963022 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:21.963027 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:21.963266 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:21.963462 (+ 196us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:21.964255 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:21.965301 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:21.967566 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:21.968174 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:21.968272 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:21.969248 (+ 976us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:21.969732 (+ 484us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:21.969805 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:21.970029 (+ 224us) server_negotiation.cc:299] Negotiation successful
0812 11:16:21.970121 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12309,"thread_start_us":16871,"threads_started":1}
I20260812 11:16:21.976281 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 9589
I20260812 11:16:21.977480 9695 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:22.089892 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 9589
I20260812 11:16:22.120406 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 9720
I20260812 11:16:22.121794 9817 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:22.228523 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 9720
I20260812 11:16:22.260108 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 9841
I20260812 11:16:22.261323 9946 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:22.368043 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 9841
2026-08-12T11:16:22Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5191 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 12 11:16:22 dist-test-slave-rmhg krb5kdc[10209](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 12 11:16:22 dist-test-slave-rmhg krb5kdc[10209](info): set up 2 sockets
Aug 12 11:16:22 dist-test-slave-rmhg krb5kdc[10209](info): commencing operation
krb5kdc: starting...
W20260812 11:16:23.665269 4201 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.005s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/test-user.keytab.
Aug 12 11:16:23 dist-test-slave-rmhg krb5kdc[10209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-12T11:16:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T11:16:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.26.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
Entry for principal kudu/127.4.26.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab.
I20260812 11:16:24.020668 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37783
--webserver_interface=127.4.26.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:33071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:37783,127.4.26.125:46279,127.4.26.124:45731
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260812 11:16:24.387624 10236 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:16:24.388026 10236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:24.388130 10236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:24.388258 10236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:24.395975 10236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:24.396103 10236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:24.396191 10236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:24.396260 10236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:24.396358 10236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:24.407155 10236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:33071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:37783,127.4.26.125:46279,127.4.26.124:45731
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.126.keytab
--principal=kudu/127.4.26.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.126:37783
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.26.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:24.408661 10236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:24.410172 10236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:24.422894 10242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:24.422868 10243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:24.422820 10245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:24.423702 10236 server_base.cc:1034] running on GCE node
I20260812 11:16:24.424561 10236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:24.426188 10236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:24.427425 10236 hybrid_clock.cc:648] HybridClock initialized: now 1786533384427350 us; error 48 us; skew 500 ppm
I20260812 11:16:24.427793 10236 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:24 dist-test-slave-rmhg krb5kdc[10209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533384, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:24.434659 10236 init.cc:377] Logged in from keytab as kudu/127.4.26.126@KRBTEST.COM (short username kudu)
I20260812 11:16:24.436472 10236 webserver.cc:460] Webserver started at http://127.4.26.126:39139/ using document root <none> and password file <none>
I20260812 11:16:24.437295 10236 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:24.437407 10236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:24.437762 10236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:24.440956 10236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/data/instance:
uuid: "b6f484a2af674b718dfc1b4ba78c8066"
format_stamp: "Formatted at 2026-08-12 11:16:24 on dist-test-slave-rmhg"
server_key: "a1b4f365c410b2bfd4105f0050cef9eb"
server_key_iv: "1d10499c75a83a52c5dda71869692b56"
server_key_version: "encryptionkey@0"
I20260812 11:16:24.441906 10236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/wal/instance:
uuid: "b6f484a2af674b718dfc1b4ba78c8066"
format_stamp: "Formatted at 2026-08-12 11:16:24 on dist-test-slave-rmhg"
server_key: "a1b4f365c410b2bfd4105f0050cef9eb"
server_key_iv: "1d10499c75a83a52c5dda71869692b56"
server_key_version: "encryptionkey@0"
I20260812 11:16:24.447780 10236 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:16:24.451879 10255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:24.453507 10236 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260812 11:16:24.453707 10236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/wal
uuid: "b6f484a2af674b718dfc1b4ba78c8066"
format_stamp: "Formatted at 2026-08-12 11:16:24 on dist-test-slave-rmhg"
server_key: "a1b4f365c410b2bfd4105f0050cef9eb"
server_key_iv: "1d10499c75a83a52c5dda71869692b56"
server_key_version: "encryptionkey@0"
I20260812 11:16:24.453951 10236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:24.466089 10236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:24.470623 10236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:24.470912 10236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:24.489769 10236 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.126:37783
I20260812 11:16:24.489789 10331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.126:37783 every 8 connection(s)
I20260812 11:16:24.491214 10236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/data/info.pb
I20260812 11:16:24.495106 10334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:24.496806 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 10236
I20260812 11:16:24.497008 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-0/wal/instance
I20260812 11:16:24.497637 4201 external_mini_cluster.cc:1428] Setting key 8b9ed94fee3a9895fe3a752a7ae4d3c1
I20260812 11:16:24.504287 10334 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:16:24 dist-test-slave-rmhg krb5kdc[10209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533384, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:16:24.531456 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:24.508573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37783 (local address 127.0.0.1:56234)
0812 11:16:24.509588 (+ 1015us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:24.509642 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:24.512121 (+ 2479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:24.513180 (+ 1059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:24.513188 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:24.513862 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:24.514226 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:24.514245 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:24.516517 (+ 2272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:24.516523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:24.517812 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:24.517826 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:24.519068 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:24.519073 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:24.519268 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:24.519964 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:24.520019 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:24.522542 (+ 2523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:24.526677 (+ 4135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:24.526690 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:24.526701 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:24.527174 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:24.527686 (+ 512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:24.527690 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:24.527692 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:24.527879 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:24.528942 (+ 1063us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:24.528957 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:24.529237 (+ 280us) client_negotiation.cc:769] Sending connection context
0812 11:16:24.529501 (+ 264us) client_negotiation.cc:240] Negotiation successful
0812 11:16:24.530355 (+ 854us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":703,"mutex_wait_us":333,"thread_start_us":426,"threads_started":1}
I20260812 11:16:24.531519 10338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:24.508573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56234 (local address 127.4.26.126:37783)
0812 11:16:24.510531 (+ 1958us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:24.510539 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:24.510590 (+ 51us) server_negotiation.cc:407] Connection header received
0812 11:16:24.512605 (+ 2015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:24.512611 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:24.512883 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:24.513083 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:24.514455 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:24.516326 (+ 1871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:24.517972 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:24.518825 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:24.519005 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:24.522818 (+ 3813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:24.522829 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:24.522847 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:24.522892 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:24.526509 (+ 3617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:24.527335 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:24.527344 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:24.527347 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:24.527545 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:24.528012 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:24.528017 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:24.528020 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:24.528770 (+ 750us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:24.528987 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:24.529700 (+ 713us) server_negotiation.cc:299] Negotiation successful
0812 11:16:24.530190 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":1755,"spinlock_wait_cycles":18176,"thread_start_us":1482,"threads_started":1}
WARNING: no policy specified for kudu/127.4.26.125@KRBTEST.COM; defaulting to no policy
I20260812 11:16:24.534754 10334 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:16:24.535960 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:24.535517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:46279 (local address 127.0.0.1:54632)
0812 11:16:24.535702 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:24.535820 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:46279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 11:16:24.536267 10259 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.26.125:46279: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.125@KRBTEST.COM" created.
I20260812 11:16:24.538020 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:24.537628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:46279 (local address 127.0.0.1:54644)
0812 11:16:24.537788 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:24.537865 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:46279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 11:16:24.538218 10334 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.125:46279: Network error: Client connection negotiation failed: client connection to 127.4.26.125:46279: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.125.keytab.
Entry for principal kudu/127.4.26.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.125.keytab.
I20260812 11:16:24.576465 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.125:46279
--webserver_interface=127.4.26.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.125.keytab
--principal=kudu/127.4.26.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:33071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:37783,127.4.26.125:46279,127.4.26.124:45731
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:16:24.587615 10334 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } attempt: 1
I20260812 11:16:24.588819 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:24.588355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:46279 (local address 127.0.0.1:54654)
0812 11:16:24.588561 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:24.588670 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:46279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260812 11:16:24.590003 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:24.589525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:46279 (local address 127.0.0.1:54666)
0812 11:16:24.589732 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:24.589827 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:46279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260812 11:16:24.590245 10334 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.125:46279: Network error: Client connection negotiation failed: client connection to 127.4.26.125:46279: connect: Connection refused (error 111)
I20260812 11:16:24.658483 10334 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } attempt: 2
I20260812 11:16:24.659754 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:24.659227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:46279 (local address 127.0.0.1:54676)
0812 11:16:24.659452 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:24.659594 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:46279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260812 11:16:24.660904 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:24.660459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:46279 (local address 127.0.0.1:54678)
0812 11:16:24.660666 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:24.660762 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:46279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
W20260812 11:16:24.661120 10334 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.125:46279: Network error: Client connection negotiation failed: client connection to 127.4.26.125:46279: connect: Connection refused (error 111)
I20260812 11:16:24.752452 10334 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } attempt: 3
I20260812 11:16:24.753731 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:24.753234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:46279 (local address 127.0.0.1:54684)
0812 11:16:24.753433 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:24.753575 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:46279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 11:16:24.754969 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:24.754568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:46279 (local address 127.0.0.1:54690)
0812 11:16:24.754706 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:24.754791 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:46279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 11:16:24.755239 10334 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.125:46279: Network error: Client connection negotiation failed: client connection to 127.4.26.125:46279: connect: Connection refused (error 111)
I20260812 11:16:24.898522 10334 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } attempt: 4
I20260812 11:16:24.899777 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:24.899225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:46279 (local address 127.0.0.1:54704)
0812 11:16:24.899539 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:24.899640 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:46279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168}
I20260812 11:16:24.901008 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:24.900605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:46279 (local address 127.0.0.1:54714)
0812 11:16:24.900769 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:24.900866 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.125:46279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260812 11:16:24.901268 10334 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.125:46279: Network error: Client connection negotiation failed: client connection to 127.4.26.125:46279: connect: Connection refused (error 111)
W20260812 11:16:24.933907 10345 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:16:24.934273 10345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:24.934379 10345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:24.934490 10345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:24.941900 10345 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:24.942018 10345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:24.942080 10345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:24.942155 10345 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:24.942245 10345 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:24.952847 10345 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:33071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:37783,127.4.26.125:46279,127.4.26.124:45731
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.125.keytab
--principal=kudu/127.4.26.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.125:46279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.26.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:24.954335 10345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:24.955765 10345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:24.968235 10352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:24.968303 10351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:24.968276 10356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:24.969121 10345 server_base.cc:1034] running on GCE node
I20260812 11:16:24.969988 10345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:24.971592 10345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:24.972831 10345 hybrid_clock.cc:648] HybridClock initialized: now 1786533384972739 us; error 78 us; skew 500 ppm
I20260812 11:16:24.973232 10345 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:24 dist-test-slave-rmhg krb5kdc[10209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533384, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:24.976583 10345 init.cc:377] Logged in from keytab as kudu/127.4.26.125@KRBTEST.COM (short username kudu)
I20260812 11:16:24.978293 10345 webserver.cc:460] Webserver started at http://127.4.26.125:39939/ using document root <none> and password file <none>
I20260812 11:16:24.979027 10345 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:24.979122 10345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:24.979444 10345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:24.982647 10345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/data/instance:
uuid: "06ed95a7835f472abffc67ab3a4bc76a"
format_stamp: "Formatted at 2026-08-12 11:16:24 on dist-test-slave-rmhg"
server_key: "0b5896c71dea987bcd26a39438b6a385"
server_key_iv: "3b911f86f3ccbddc67be3fd96628f9ab"
server_key_version: "encryptionkey@0"
I20260812 11:16:24.983470 10345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/wal/instance:
uuid: "06ed95a7835f472abffc67ab3a4bc76a"
format_stamp: "Formatted at 2026-08-12 11:16:24 on dist-test-slave-rmhg"
server_key: "0b5896c71dea987bcd26a39438b6a385"
server_key_iv: "3b911f86f3ccbddc67be3fd96628f9ab"
server_key_version: "encryptionkey@0"
I20260812 11:16:24.989509 10345 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260812 11:16:24.993407 10364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:24.994936 10345 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260812 11:16:24.995108 10345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/wal
uuid: "06ed95a7835f472abffc67ab3a4bc76a"
format_stamp: "Formatted at 2026-08-12 11:16:24 on dist-test-slave-rmhg"
server_key: "0b5896c71dea987bcd26a39438b6a385"
server_key_iv: "3b911f86f3ccbddc67be3fd96628f9ab"
server_key_version: "encryptionkey@0"
I20260812 11:16:24.995309 10345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:25.018936 10345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:25.023563 10345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:25.023808 10345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:25.041947 10345 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.125:46279
I20260812 11:16:25.041954 10454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.125:46279 every 8 connection(s)
I20260812 11:16:25.043376 10345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/data/info.pb
I20260812 11:16:25.047452 10455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:25.053869 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 10345
I20260812 11:16:25.054096 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-1/wal/instance
I20260812 11:16:25.054791 4201 external_mini_cluster.cc:1428] Setting key 2172bced37c0b251e70c89be129c89af
I20260812 11:16:25.054981 10455 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:16:25 dist-test-slave-rmhg krb5kdc[10209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533384, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.125@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:16:25.079290 10458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.058554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56240 (local address 127.4.26.126:37783)
0812 11:16:25.059082 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:25.059088 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:25.060328 (+ 1240us) server_negotiation.cc:407] Connection header received
0812 11:16:25.062355 (+ 2027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:25.062361 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:25.062460 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:25.062584 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:25.064233 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.065273 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.066993 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.067582 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.067719 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.072223 (+ 4504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:25.072231 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:25.072236 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:25.072299 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:25.075328 (+ 3029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.076444 (+ 1116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.076449 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.076451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.076642 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.077264 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.077268 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.077270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.077650 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:25.077772 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:25.078799 (+ 1027us) server_negotiation.cc:299] Negotiation successful
0812 11:16:25.079015 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":256,"threads_started":1}
I20260812 11:16:25.081059 10459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.059206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37783 (local address 127.0.0.1:56240)
0812 11:16:25.060133 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.060190 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:25.062065 (+ 1875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:25.062796 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:25.062804 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:25.063394 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:25.063982 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:25.064001 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.065468 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.065472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:25.066804 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:25.066819 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.067864 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.067870 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:25.068147 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.068980 (+ 833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:25.069012 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:25.071862 (+ 2850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:25.075568 (+ 3706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:25.075581 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:25.075614 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:25.076296 (+ 682us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:25.076772 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:25.076777 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:25.076781 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:25.077090 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:25.077791 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:25.077800 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:25.078308 (+ 508us) client_negotiation.cc:769] Sending connection context
0812 11:16:25.078668 (+ 360us) client_negotiation.cc:240] Negotiation successful
0812 11:16:25.079451 (+ 783us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":379,"threads_started":1}
I20260812 11:16:25.083287 10455 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.4.26.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.26.124@KRBTEST.COM" created.
Aug 12 11:16:25 dist-test-slave-rmhg krb5kdc[10209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533384, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.125@KRBTEST.COM for kudu/127.4.26.125@KRBTEST.COM
I20260812 11:16:25.100822 10459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.084241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:46279 (local address 127.0.0.1:54716)
0812 11:16:25.084478 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.084500 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:25.084637 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:25.085828 (+ 1191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:25.085837 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:25.086367 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:25.086592 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:25.086606 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.088178 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.088184 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:25.089590 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:25.089609 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.090647 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.090655 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:25.090838 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.091472 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:25.091493 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:25.094472 (+ 2979us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:25.098000 (+ 3528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:25.098006 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:25.098010 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:25.098484 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:25.098919 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:25.098924 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:25.098927 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:25.099102 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:25.099865 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:25.099873 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:25.100037 (+ 164us) client_negotiation.cc:769] Sending connection context
0812 11:16:25.100178 (+ 141us) client_negotiation.cc:240] Negotiation successful
0812 11:16:25.100481 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260812 11:16:25.100945 10461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.084557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54716 (local address 127.4.26.125:46279)
0812 11:16:25.085330 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:25.085337 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:25.085367 (+ 30us) server_negotiation.cc:407] Connection header received
0812 11:16:25.085418 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:25.085424 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:25.085644 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:25.085776 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:25.086814 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.087998 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.089758 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.090394 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.090515 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.094776 (+ 4261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:25.094794 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:25.094812 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:25.094855 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:25.097841 (+ 2986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.098640 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.098648 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.098650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.098799 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.099232 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.099237 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.099240 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.099745 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:25.099927 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:25.100362 (+ 435us) server_negotiation.cc:299] Negotiation successful
0812 11:16:25.100618 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":428,"threads_started":1}
I20260812 11:16:25.103892 10455 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:16:25.105271 10459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.104644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35150)
0812 11:16:25.104842 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.105002 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 11:16:25.105647 10370 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
I20260812 11:16:25.107374 10459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.106964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35156)
0812 11:16:25.107137 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.107231 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260812 11:16:25.107662 10455 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:45731: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.26.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.124.keytab.
Entry for principal kudu/127.4.26.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.124.keytab.
I20260812 11:16:25.132246 4201 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskpQKIib/build/asan/bin/kudu
/tmp/dist-test-taskpQKIib/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.124:45731
--webserver_interface=127.4.26.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.124.keytab
--principal=kudu/127.4.26.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.26.84:33071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.26.126:37783,127.4.26.125:46279,127.4.26.124:45731
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260812 11:16:25.157053 10455 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } attempt: 1
I20260812 11:16:25.158429 10459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.157860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35158)
0812 11:16:25.158067 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.158190 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260812 11:16:25.159605 10459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.159186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35172)
0812 11:16:25.159351 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.159434 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260812 11:16:25.159900 10455 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:45731: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
I20260812 11:16:25.201031 10334 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } attempt: 5
Aug 12 11:16:25 dist-test-slave-rmhg krb5kdc[10209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533384, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for kudu/127.4.26.125@KRBTEST.COM
I20260812 11:16:25.218806 10461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.202280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54720 (local address 127.4.26.125:46279)
0812 11:16:25.202438 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:25.202443 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:25.202462 (+ 19us) server_negotiation.cc:407] Connection header received
0812 11:16:25.202575 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:25.202578 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:25.202662 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:25.202764 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:25.204001 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.204818 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.206644 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.207140 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.207291 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.211464 (+ 4173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:25.211472 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:25.211490 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:25.211539 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:25.215115 (+ 3576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.216122 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.216129 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.216132 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.216293 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.216794 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.216801 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.216804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.217251 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:25.217397 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:25.218142 (+ 745us) server_negotiation.cc:299] Negotiation successful
0812 11:16:25.218416 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260812 11:16:25.219913 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.201847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:46279 (local address 127.0.0.1:54720)
0812 11:16:25.202101 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.202128 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:25.202280 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:25.202848 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:25.202853 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:25.203547 (+ 694us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:25.203818 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:25.203832 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.204987 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.204993 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:25.206448 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:25.206488 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.207319 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.207325 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:25.207580 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.208323 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:25.208348 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:25.211163 (+ 2815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:25.215326 (+ 4163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:25.215332 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:25.215335 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:25.215946 (+ 611us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:25.216464 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:25.216469 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:25.216473 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:25.216652 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:25.217533 (+ 881us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:25.217539 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:25.217762 (+ 223us) client_negotiation.cc:769] Sending connection context
0812 11:16:25.219111 (+ 1349us) client_negotiation.cc:240] Negotiation successful
0812 11:16:25.219490 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260812 11:16:25.221506 10334 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:16:25.223748 10468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.222436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35188)
0812 11:16:25.223142 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.223350 (+ 208us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":312,"threads_started":1}
I20260812 11:16:25.225119 10468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.224640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35198)
0812 11:16:25.224863 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.224958 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
W20260812 11:16:25.225445 10334 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:45731: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
I20260812 11:16:25.228148 10455 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } attempt: 2
I20260812 11:16:25.229302 10459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.228840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35208)
0812 11:16:25.229022 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.229108 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260812 11:16:25.230566 10459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.230094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35220)
0812 11:16:25.230315 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.230401 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
W20260812 11:16:25.230840 10455 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:45731: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
I20260812 11:16:25.276701 10334 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } attempt: 1
I20260812 11:16:25.278324 10468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.277555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35224)
0812 11:16:25.277903 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.278035 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190}
I20260812 11:16:25.279646 10468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.279168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35236)
0812 11:16:25.279389 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.279478 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
W20260812 11:16:25.279913 10334 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:45731: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
I20260812 11:16:25.322084 10455 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } attempt: 3
I20260812 11:16:25.323498 10459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.322895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35248)
0812 11:16:25.323152 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.323275 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260812 11:16:25.324887 10459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.324329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35252)
0812 11:16:25.324623 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.324733 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177}
W20260812 11:16:25.325196 10455 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:45731: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
I20260812 11:16:25.348150 10334 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } attempt: 2
I20260812 11:16:25.349594 10468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.348986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35268)
0812 11:16:25.349251 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.349375 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260812 11:16:25.350811 10468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.350355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35272)
0812 11:16:25.350550 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.350647 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260812 11:16:25.351131 10334 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:45731: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
I20260812 11:16:25.457396 10334 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } attempt: 3
I20260812 11:16:25.458719 10468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.458170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35286)
0812 11:16:25.458397 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.458517 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260812 11:16:25.460039 10468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.459566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35302)
0812 11:16:25.459762 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.459868 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260812 11:16:25.460310 10334 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:45731: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
I20260812 11:16:25.468449 10455 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } attempt: 4
I20260812 11:16:25.469863 10459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.469298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35314)
0812 11:16:25.469607 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.469701 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260812 11:16:25.470942 10459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.470587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35326)
0812 11:16:25.470753 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.470828 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260812 11:16:25.471144 10455 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:45731: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
W20260812 11:16:25.544066 10466 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260812 11:16:25.544426 10466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 11:16:25.544553 10466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 11:16:25.544647 10466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 11:16:25.552222 10466 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 11:16:25.552335 10466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260812 11:16:25.552394 10466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 11:16:25.552464 10466 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 11:16:25.552546 10466 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 11:16:25.562894 10466 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.26.84:33071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.4.26.126:37783,127.4.26.125:46279,127.4.26.124:45731
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/krb5kdc/kudu_127.4.26.124.keytab
--principal=kudu/127.4.26.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.26.124:45731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.26.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 10:10:13 UTC on ccycloud.quasar-wamklh.root.comops.site
build id 4582282
ASAN enabled
I20260812 11:16:25.564471 10466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 11:16:25.565979 10466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 11:16:25.578477 10478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:25.578543 10480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 11:16:25.578429 10483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 11:16:25.579633 10466 server_base.cc:1034] running on GCE node
I20260812 11:16:25.580556 10466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 11:16:25.582290 10466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 11:16:25.583571 10466 hybrid_clock.cc:648] HybridClock initialized: now 1786533385583495 us; error 48 us; skew 500 ppm
I20260812 11:16:25.583956 10466 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 12 11:16:25 dist-test-slave-rmhg krb5kdc[10209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533385, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260812 11:16:25.587364 10466 init.cc:377] Logged in from keytab as kudu/127.4.26.124@KRBTEST.COM (short username kudu)
I20260812 11:16:25.588937 10466 webserver.cc:460] Webserver started at http://127.4.26.124:41377/ using document root <none> and password file <none>
I20260812 11:16:25.589727 10466 fs_manager.cc:359] Metadata directory not provided
I20260812 11:16:25.589826 10466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 11:16:25.590127 10466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 11:16:25.593261 10466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/data/instance:
uuid: "7f505b440c544b4ea89bda1577018d24"
format_stamp: "Formatted at 2026-08-12 11:16:25 on dist-test-slave-rmhg"
server_key: "5d314fc6ee2809af4e0b00cb64b0ff10"
server_key_iv: "00efe864d4bdba847ba50211a1424ae9"
server_key_version: "encryptionkey@0"
I20260812 11:16:25.594115 10466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/wal/instance:
uuid: "7f505b440c544b4ea89bda1577018d24"
format_stamp: "Formatted at 2026-08-12 11:16:25 on dist-test-slave-rmhg"
server_key: "5d314fc6ee2809af4e0b00cb64b0ff10"
server_key_iv: "00efe864d4bdba847ba50211a1424ae9"
server_key_version: "encryptionkey@0"
I20260812 11:16:25.599912 10466 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260812 11:16:25.605101 10496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 11:16:25.606701 10466 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260812 11:16:25.606911 10466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/data,/tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/wal
uuid: "7f505b440c544b4ea89bda1577018d24"
format_stamp: "Formatted at 2026-08-12 11:16:25 on dist-test-slave-rmhg"
server_key: "5d314fc6ee2809af4e0b00cb64b0ff10"
server_key_iv: "00efe864d4bdba847ba50211a1424ae9"
server_key_version: "encryptionkey@0"
I20260812 11:16:25.607177 10466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 11:16:25.637579 10334 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } attempt: 4
I20260812 11:16:25.638746 10468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.638208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35340)
0812 11:16:25.638463 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.638578 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260812 11:16:25.639918 10468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.639512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35348)
0812 11:16:25.639670 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.639777 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260812 11:16:25.640177 10334 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.26.124:45731: Network error: Client connection negotiation failed: client connection to 127.4.26.124:45731: connect: Connection refused (error 111)
I20260812 11:16:25.641127 10466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 11:16:25.645570 10466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 11:16:25.645825 10466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 11:16:25.663542 10466 rpc_server.cc:307] RPC server started. Bound to: 127.4.26.124:45731
I20260812 11:16:25.663568 10597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.26.124:45731 every 8 connection(s)
I20260812 11:16:25.665016 10466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/data/info.pb
I20260812 11:16:25.669289 10598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 11:16:25.673812 4201 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskpQKIib/build/asan/bin/kudu as pid 10466
I20260812 11:16:25.674018 4201 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskpQKIib/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786532997575371-4201-0/minicluster-data/master-2/wal/instance
I20260812 11:16:25.674602 4201 external_mini_cluster.cc:1428] Setting key 771b65ecc402238564212ae14e9ad53a
I20260812 11:16:25.677635 10598 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:16:25 dist-test-slave-rmhg krb5kdc[10209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.124@KRBTEST.COM
Aug 12 11:16:25 dist-test-slave-rmhg krb5kdc[10209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533385, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.124@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:16:25.697024 10605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.681871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56252 (local address 127.4.26.126:37783)
0812 11:16:25.682400 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:25.682406 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:25.682976 (+ 570us) server_negotiation.cc:407] Connection header received
0812 11:16:25.683175 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:25.683181 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:25.683284 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:25.683411 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:25.684694 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.685576 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.687089 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.687526 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.687666 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.691450 (+ 3784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:25.691455 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:25.691458 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:25.691494 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:25.693974 (+ 2480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.694658 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.694663 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.694665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.694798 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.695208 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.695212 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.695214 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.695474 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:25.695619 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:25.696346 (+ 727us) server_negotiation.cc:299] Negotiation successful
0812 11:16:25.696598 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":242,"threads_started":1}
I20260812 11:16:25.698042 10608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.681806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.126:37783 (local address 127.0.0.1:56252)
0812 11:16:25.682780 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.682848 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:25.683043 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:25.683472 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:25.683478 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:25.684207 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:25.684522 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:25.684534 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.685744 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.685749 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:25.686921 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:25.686935 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.687798 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.687807 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:25.687973 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.688614 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:25.688638 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:25.691228 (+ 2590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:25.694110 (+ 2882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:25.694125 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:25.694140 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:25.694538 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:25.694905 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:25.694911 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:25.694914 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:25.695103 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:25.695597 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:25.695606 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:25.695975 (+ 369us) client_negotiation.cc:769] Sending connection context
0812 11:16:25.696254 (+ 279us) client_negotiation.cc:240] Negotiation successful
0812 11:16:25.696787 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":706,"mutex_wait_us":35,"thread_start_us":545,"threads_started":1}
I20260812 11:16:25.698056 10603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.676783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35362 (local address 127.4.26.124:45731)
0812 11:16:25.677710 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:25.677724 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:25.677781 (+ 57us) server_negotiation.cc:407] Connection header received
0812 11:16:25.679763 (+ 1982us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:25.679795 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:25.680339 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:25.680753 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:25.682545 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.684222 (+ 1677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.685784 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.686577 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.686784 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.691182 (+ 4398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:25.691191 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:25.691207 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:25.691243 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:25.694121 (+ 2878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.694835 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.694842 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.694844 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.695010 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.695391 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.695394 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.695397 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.695960 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:25.696258 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:25.696597 (+ 339us) server_negotiation.cc:299] Negotiation successful
0812 11:16:25.696904 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":684,"thread_start_us":404,"threads_started":1}
I20260812 11:16:25.699718 10598 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } has no permanent_uuid. Determining permanent_uuid...
Aug 12 11:16:25 dist-test-slave-rmhg krb5kdc[10209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533385, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.124@KRBTEST.COM for kudu/127.4.26.125@KRBTEST.COM
Aug 12 11:16:25 dist-test-slave-rmhg krb5kdc[10209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.126@KRBTEST.COM
I20260812 11:16:25.715397 10461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.700473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54724 (local address 127.4.26.125:46279)
0812 11:16:25.700638 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:25.700645 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:25.700663 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:16:25.700805 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:25.700811 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:25.700881 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:25.700971 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:25.701854 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.702665 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.704058 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.704738 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.704877 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.708996 (+ 4119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:25.709002 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:25.709006 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:25.709045 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:25.712321 (+ 3276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.713265 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.713272 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.713276 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.713510 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.713957 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.713962 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.713965 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.714344 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:25.714538 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:25.714935 (+ 397us) server_negotiation.cc:299] Negotiation successful
0812 11:16:25.715127 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260812 11:16:25.715528 10608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.700405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.125:46279 (local address 127.0.0.1:54724)
0812 11:16:25.700571 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.700590 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:25.700690 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:25.700995 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:25.701000 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:25.701526 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:25.701712 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:25.701723 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.702809 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.702815 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:25.703880 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:25.703893 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.704914 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.704919 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:25.705200 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.706415 (+ 1215us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:25.706442 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:25.708735 (+ 2293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:25.712516 (+ 3781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:25.712523 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:25.712527 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:25.713091 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:25.713650 (+ 559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:25.713655 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:25.713657 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:25.713824 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:25.714513 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:25.714518 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:25.714675 (+ 157us) client_negotiation.cc:769] Sending connection context
0812 11:16:25.714827 (+ 152us) client_negotiation.cc:240] Negotiation successful
0812 11:16:25.715178 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260812 11:16:25.716501 10598 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } has no permanent_uuid. Determining permanent_uuid...
I20260812 11:16:25.718756 10605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.701465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56262 (local address 127.4.26.126:37783)
0812 11:16:25.701628 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:25.701631 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:25.701649 (+ 18us) server_negotiation.cc:407] Connection header received
0812 11:16:25.701827 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:25.701831 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:25.701903 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:25.702001 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:25.703242 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.704048 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.705694 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.706101 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.706202 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.711091 (+ 4889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:25.711098 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:25.711103 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:25.711152 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:25.714664 (+ 3512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.715695 (+ 1031us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.715701 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.715704 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.715875 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.716283 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.716287 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.716289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.716659 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:25.716940 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:25.718169 (+ 1229us) server_negotiation.cc:299] Negotiation successful
0812 11:16:25.718415 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
Aug 12 11:16:25 dist-test-slave-rmhg krb5kdc[10209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533385, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.124@KRBTEST.COM for kudu/127.4.26.124@KRBTEST.COM
Aug 12 11:16:25 dist-test-slave-rmhg krb5kdc[10209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.26.125@KRBTEST.COM
I20260812 11:16:25.730649 10608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.717317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35378)
0812 11:16:25.717491 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.717510 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:25.717638 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:25.717953 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:25.717958 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:25.718441 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:25.718628 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:25.718640 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.719716 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.719722 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:25.720937 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:25.720950 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.721731 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.721738 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:25.721970 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.722560 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:25.722582 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:25.724744 (+ 2162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:25.727866 (+ 3122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:25.727873 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:25.727877 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:25.728379 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:25.728727 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:25.728733 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:25.728736 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:25.728881 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:25.729604 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:25.729609 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:25.729760 (+ 151us) client_negotiation.cc:769] Sending connection context
0812 11:16:25.729939 (+ 179us) client_negotiation.cc:240] Negotiation successful
0812 11:16:25.730269 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260812 11:16:25.730841 10603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.717570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35378 (local address 127.4.26.124:45731)
0812 11:16:25.717732 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:25.717738 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:25.717752 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:16:25.717790 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:25.717793 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:25.717843 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:25.717917 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:25.718789 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.719587 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.721072 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.721575 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.721673 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.724944 (+ 3271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:25.724952 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:25.724956 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:25.724993 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:25.727721 (+ 2728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.728488 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.728492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.728494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.728613 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.728992 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.728997 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.729001 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.729394 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:25.729552 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:25.730046 (+ 494us) server_negotiation.cc:299] Negotiation successful
0812 11:16:25.730473 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":172,"server-negotiator.queue_time_us":67}
I20260812 11:16:25.737097 10598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24: Bootstrap starting.
I20260812 11:16:25.737869 10461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.720692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54730 (local address 127.4.26.125:46279)
0812 11:16:25.720844 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:25.720848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:25.720864 (+ 16us) server_negotiation.cc:407] Connection header received
0812 11:16:25.720924 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:25.720928 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:25.720986 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:25.721081 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:25.722610 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.723422 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.724997 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.725692 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.725791 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.730663 (+ 4872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:25.730670 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:25.730675 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:25.730722 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:25.734569 (+ 3847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.735378 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.735384 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.735388 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.735575 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.735995 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.736001 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.736004 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.736383 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:25.736652 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:25.737262 (+ 610us) server_negotiation.cc:299] Negotiation successful
0812 11:16:25.737525 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:16:25.740832 10598 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:25.742137 10598 log.cc:824] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:25.742988 4201 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260812 11:16:25.744943 10598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24: No bootstrap required, opened a new log
I20260812 11:16:25.745493 10293 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b6f484a2af674b718dfc1b4ba78c8066"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56262
I20260812 11:16:25.756052 10598 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } }
I20260812 11:16:25.756546 10598 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f505b440c544b4ea89bda1577018d24, State: Initialized, Role: FOLLOWER
I20260812 11:16:25.757087 10598 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } }
I20260812 11:16:25.758183 10610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } } }
I20260812 11:16:25.758611 10610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:16:25.759568 10598 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 11:16:25.769309 10632 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:16:25.769526 10632 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:16:25.770354 10455 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } attempt: 5
I20260812 11:16:25.767200 10466 master_runner.cc:186] Error getting master registration for 127.4.26.126:37783: OK, instance_id { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" instance_seqno: 1786533384484454 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:16:25.778386 10466 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 12 11:16:25 dist-test-slave-rmhg krb5kdc[10209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533384, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.125@KRBTEST.COM for kudu/127.4.26.124@KRBTEST.COM
I20260812 11:16:25.789209 10459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.771048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35380)
0812 11:16:25.771242 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.771263 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:25.771367 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:25.771822 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:25.771827 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:25.772380 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:25.772598 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:25.772610 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.774317 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.774324 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:25.775725 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:25.775746 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.777095 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.777103 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:25.777373 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.778060 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:25.778086 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:25.781062 (+ 2976us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:25.785440 (+ 4378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:25.785448 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:25.785452 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:25.786094 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:25.786593 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:25.786598 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:25.786602 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:25.786781 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:25.787646 (+ 865us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:25.787651 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:25.787841 (+ 190us) client_negotiation.cc:769] Sending connection context
0812 11:16:25.788326 (+ 485us) client_negotiation.cc:240] Negotiation successful
0812 11:16:25.788713 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260812 11:16:25.789562 10603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.771113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35380 (local address 127.4.26.124:45731)
0812 11:16:25.771537 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:25.771541 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:25.771555 (+ 14us) server_negotiation.cc:407] Connection header received
0812 11:16:25.771600 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:25.771604 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:25.771677 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:25.771773 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:25.772794 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.774099 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.775911 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.776670 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.776814 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.781331 (+ 4517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:25.781340 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:25.781345 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:25.781391 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:25.785231 (+ 3840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.786267 (+ 1036us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.786274 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.786278 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.786462 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.786953 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.786959 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.786962 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.787521 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:25.787710 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:25.788452 (+ 742us) server_negotiation.cc:299] Negotiation successful
0812 11:16:25.788839 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318}
I20260812 11:16:25.796026 10455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a: Bootstrap starting.
I20260812 11:16:25.800576 10455 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:25.802282 10455 log.cc:824] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:25.806391 10455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a: No bootstrap required, opened a new log
I20260812 11:16:25.818017 10455 raft_consensus.cc:348] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } }
I20260812 11:16:25.818560 10455 raft_consensus.cc:729] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ed95a7835f472abffc67ab3a4bc76a, State: Initialized, Role: FOLLOWER
I20260812 11:16:25.819222 10455 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } }
I20260812 11:16:25.820375 10637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } } }
I20260812 11:16:25.820813 10637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:16:25.821973 10455 sys_catalog.cc:564] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a [sys.catalog]: configured and running, proceeding with master startup.
W20260812 11:16:25.838114 10658 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 11:16:25.838303 10658 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 11:16:25.835418 10345 master_runner.cc:186] Error getting master registration for 127.4.26.126:37783: OK, instance_id { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" instance_seqno: 1786533384484454 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 11:16:25.847075 10345 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 11:16:25.898156 10508 tablet.cc:2369] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:16:25.917403 10334 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } attempt: 5
Aug 12 11:16:25 dist-test-slave-rmhg krb5kdc[10209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786533384, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.26.126@KRBTEST.COM for kudu/127.4.26.124@KRBTEST.COM
I20260812 11:16:25.936861 10468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.918220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.26.124:45731 (local address 127.0.0.1:35388)
0812 11:16:25.918549 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0812 11:16:25.918570 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0812 11:16:25.918730 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 11:16:25.919168 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0812 11:16:25.919173 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0812 11:16:25.919793 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0812 11:16:25.920137 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:25.920153 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.921789 (+ 1636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.921795 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:25.923292 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0812 11:16:25.923311 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.924512 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.924519 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0812 11:16:25.924743 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.925554 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0812 11:16:25.925579 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0812 11:16:25.928671 (+ 3092us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0812 11:16:25.933608 (+ 4937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:25.933615 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:25.933619 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:25.934262 (+ 643us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:25.934806 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0812 11:16:25.934812 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0812 11:16:25.934816 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0812 11:16:25.934997 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0812 11:16:25.935731 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0812 11:16:25.935737 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0812 11:16:25.935935 (+ 198us) client_negotiation.cc:769] Sending connection context
0812 11:16:25.936094 (+ 159us) client_negotiation.cc:240] Negotiation successful
0812 11:16:25.936417 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198}
I20260812 11:16:25.938000 10603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:25.918272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35388 (local address 127.4.26.124:45731)
0812 11:16:25.918466 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:25.918472 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:25.918674 (+ 202us) server_negotiation.cc:407] Connection header received
0812 11:16:25.918865 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:25.918872 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:25.918994 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:25.919124 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:25.920331 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.921551 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.923482 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:25.924282 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:25.924454 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:25.928966 (+ 4512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:25.928973 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:25.928979 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:25.929034 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:25.933368 (+ 4334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.934444 (+ 1076us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.934451 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.934459 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.934650 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:25.935145 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:25.935150 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:25.935154 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:25.935512 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:25.935661 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:25.937338 (+ 1677us) server_negotiation.cc:299] Negotiation successful
0812 11:16:25.937616 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:16:25.944310 10334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066: Bootstrap starting.
I20260812 11:16:25.948643 10334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066: Neither blocks nor log segments found. Creating new log.
I20260812 11:16:25.950197 10334 log.cc:824] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066: Log is configured to *not* fsync() on all Append() calls
I20260812 11:16:25.954483 10334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066: No bootstrap required, opened a new log
I20260812 11:16:25.963007 10334 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } }
I20260812 11:16:25.963455 10334 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f484a2af674b718dfc1b4ba78c8066, State: Initialized, Role: FOLLOWER
I20260812 11:16:25.964051 10334 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } }
I20260812 11:16:25.970197 10663 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } } }
I20260812 11:16:25.971091 10663 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:16:25.971482 10334 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 11:16:25.971551 10293 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260812 11:16:25.971786 10293 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [term 0 FOLLOWER]: Advancing to term 1
W20260812 11:16:25.974099 10264 tablet.cc:2369] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:16:25.975363 10293 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } }
I20260812 11:16:25.978538 10416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b6f484a2af674b718dfc1b4ba78c8066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "06ed95a7835f472abffc67ab3a4bc76a"
I20260812 11:16:25.978798 10544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b6f484a2af674b718dfc1b4ba78c8066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7f505b440c544b4ea89bda1577018d24"
I20260812 11:16:25.979104 10416 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:25.979317 10544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24 [term 0 FOLLOWER]: Advancing to term 1
I20260812 11:16:25.982888 10416 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f484a2af674b718dfc1b4ba78c8066 in term 1.
I20260812 11:16:25.983045 10544 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6f484a2af674b718dfc1b4ba78c8066 in term 1.
I20260812 11:16:25.983747 10293 leader_election.cc:288] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [CANDIDATE]: Term 1 election: Requested vote from peers 06ed95a7835f472abffc67ab3a4bc76a (127.4.26.125:46279), 7f505b440c544b4ea89bda1577018d24 (127.4.26.124:45731)
I20260812 11:16:25.983789 10259 leader_election.cc:302] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f505b440c544b4ea89bda1577018d24, b6f484a2af674b718dfc1b4ba78c8066; no voters:
I20260812 11:16:25.990808 10663 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 11:16:26.001102 10663 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [term 1 LEADER]: Becoming Leader. State: Replica: b6f484a2af674b718dfc1b4ba78c8066, State: Running, Role: LEADER
I20260812 11:16:26.002043 10663 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } }
I20260812 11:16:26.018364 10669 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6f484a2af674b718dfc1b4ba78c8066. Latest consensus state: current_term: 1 leader_uuid: "b6f484a2af674b718dfc1b4ba78c8066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } } }
I20260812 11:16:26.019047 10669 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [sys.catalog]: This master's current role is: LEADER
W20260812 11:16:26.026628 10374 tablet.cc:2369] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 11:16:26.029999 10682 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 11:16:26.052582 10682 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 11:16:26.059291 10702 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 11:16:26.078751 10544 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24 [term 1 FOLLOWER]: Refusing update from remote peer b6f484a2af674b718dfc1b4ba78c8066: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:26.079841 10669 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:26.087800 10416 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a [term 1 FOLLOWER]: Refusing update from remote peer b6f484a2af674b718dfc1b4ba78c8066: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 11:16:26.088810 10669 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 11:16:26.105784 10605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:26.020420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56266 (local address 127.4.26.126:37783)
0812 11:16:26.020616 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.020624 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.033692 (+ 13068us) server_negotiation.cc:407] Connection header received
0812 11:16:26.035515 (+ 1823us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.035522 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.035616 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.035702 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:26.056409 (+ 20707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:26.057651 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:26.072169 (+ 14518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:26.072921 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:26.073034 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:26.085311 (+ 12277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:26.085319 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:26.085324 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:26.085374 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:26.089138 (+ 3764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:26.101311 (+ 12173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:26.101318 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:26.101322 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:26.101525 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:26.102030 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:26.102035 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:26.102039 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:26.102458 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:26.102772 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:26.104875 (+ 2103us) server_negotiation.cc:299] Negotiation successful
0812 11:16:26.105218 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260812 11:16:26.111229 10610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6f484a2af674b718dfc1b4ba78c8066. Latest consensus state: current_term: 1 leader_uuid: "b6f484a2af674b718dfc1b4ba78c8066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } } }
I20260812 11:16:26.111748 10610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:16:26.112648 10461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:26.024031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54734 (local address 127.4.26.125:46279)
0812 11:16:26.024228 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.024234 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.038694 (+ 14460us) server_negotiation.cc:407] Connection header received
0812 11:16:26.039653 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.039659 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.039755 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.039835 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:26.059081 (+ 19246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:26.060348 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:26.077394 (+ 17046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:26.078099 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:26.078222 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:26.090628 (+ 12406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:26.090635 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:26.090640 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:26.090688 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:26.095071 (+ 4383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:26.103307 (+ 8236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:26.103318 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:26.103322 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:26.103491 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:26.106321 (+ 2830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:26.106327 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:26.106331 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:26.106735 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:26.107013 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:26.111741 (+ 4728us) server_negotiation.cc:299] Negotiation successful
0812 11:16:26.112226 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260812 11:16:26.115629 10704 mvcc.cc:205] Tried to move back new op lower bound from 7317640749365444608 to 7317640749084909568. Current Snapshot: MvccSnapshot[applied={T|T < 7317640749365444608}]
I20260812 11:16:26.116345 10705 mvcc.cc:205] Tried to move back new op lower bound from 7317640749365444608 to 7317640749084909568. Current Snapshot: MvccSnapshot[applied={T|T < 7317640749365444608}]
I20260812 11:16:26.117084 10603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:26.034313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35402 (local address 127.4.26.124:45731)
0812 11:16:26.034494 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.034500 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.039383 (+ 4883us) server_negotiation.cc:407] Connection header received
0812 11:16:26.052973 (+ 13590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.052983 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.053108 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.053234 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:26.061883 (+ 8649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:26.063052 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:26.077963 (+ 14911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:26.078685 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:26.078794 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:26.096284 (+ 17490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0812 11:16:26.096296 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0812 11:16:26.096301 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0812 11:16:26.096351 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0812 11:16:26.100339 (+ 3988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:26.104029 (+ 3690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:26.104036 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:26.104040 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:26.104222 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0812 11:16:26.109748 (+ 5526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0812 11:16:26.109755 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0812 11:16:26.109759 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0812 11:16:26.110331 (+ 572us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0812 11:16:26.110615 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:26.114565 (+ 3950us) server_negotiation.cc:299] Negotiation successful
0812 11:16:26.116370 (+ 1805us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260812 11:16:26.143730 10637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6f484a2af674b718dfc1b4ba78c8066. Latest consensus state: current_term: 1 leader_uuid: "b6f484a2af674b718dfc1b4ba78c8066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } } }
I20260812 11:16:26.144011 10637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:16:26.144122 10682 catalog_manager.cc:1347] Generated new cluster ID: 04f207cc5d964adc8d7bbf2d03f757e9
I20260812 11:16:26.144233 10682 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 11:16:26.145707 10610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b6f484a2af674b718dfc1b4ba78c8066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } } }
I20260812 11:16:26.145980 10610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:16:26.147305 10669 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b6f484a2af674b718dfc1b4ba78c8066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } } }
I20260812 11:16:26.147570 10669 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:26.162572 10706 mvcc.cc:205] Tried to move back new op lower bound from 7317640749365444608 to 7317640749084909568. Current Snapshot: MvccSnapshot[applied={T|T < 7317640749365444608}]
I20260812 11:16:26.169881 10637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b6f484a2af674b718dfc1b4ba78c8066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } } }
I20260812 11:16:26.170192 10637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 11:16:26.173096 10717 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b6f484a2af674b718dfc1b4ba78c8066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6f484a2af674b718dfc1b4ba78c8066" member_type: VOTER last_known_addr { host: "127.4.26.126" port: 37783 } } peers { permanent_uuid: "06ed95a7835f472abffc67ab3a4bc76a" member_type: VOTER last_known_addr { host: "127.4.26.125" port: 46279 } } peers { permanent_uuid: "7f505b440c544b4ea89bda1577018d24" member_type: VOTER last_known_addr { host: "127.4.26.124" port: 45731 } } }
I20260812 11:16:26.174268 10717 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066 [sys.catalog]: This master's current role is: LEADER
I20260812 11:16:26.195756 10682 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 11:16:26.197839 10682 catalog_manager.cc:1504] Loading token signing keys...
I20260812 11:16:26.214790 10682 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6f484a2af674b718dfc1b4ba78c8066: Generated new TSK 0
I20260812 11:16:26.216090 10682 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260812 11:16:26.374101 10605 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:26.347287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56282 (local address 127.4.26.126:37783)
0812 11:16:26.347598 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.347605 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.368892 (+ 21287us) server_negotiation.cc:407] Connection header received
0812 11:16:26.372250 (+ 3358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.372258 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.372357 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.372440 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:26.373840 (+ 1400us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56282: BlockingRecv error: recv got EOF from 127.0.0.1:56282 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260812 11:16:26.377758 10461 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:26.353463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54750 (local address 127.4.26.125:46279)
0812 11:16:26.353677 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.353683 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.375090 (+ 21407us) server_negotiation.cc:407] Connection header received
0812 11:16:26.376118 (+ 1028us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.376125 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.376236 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.376312 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:26.377505 (+ 1193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54750: BlockingRecv error: recv got EOF from 127.0.0.1:54750 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260812 11:16:26.380451 10603 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:26.369616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35404 (local address 127.4.26.124:45731)
0812 11:16:26.369817 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.369822 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.375822 (+ 6000us) server_negotiation.cc:407] Connection header received
0812 11:16:26.378898 (+ 3076us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.378904 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.378998 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.379073 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:26.380217 (+ 1144us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35404: BlockingRecv error: recv got EOF from 127.0.0.1:35404 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260812 11:16:26.415774 10461 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:26.411043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54752 (local address 127.4.26.125:46279)
0812 11:16:26.411262 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.411268 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.413832 (+ 2564us) server_negotiation.cc:407] Connection header received
0812 11:16:26.414239 (+ 407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.414246 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.414393 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.414511 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:26.415511 (+ 1000us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54752: BlockingRecv error: recv got EOF from 127.0.0.1:54752 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260812 11:16:26.423364 10461 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:26.421389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54768 (local address 127.4.26.125:46279)
0812 11:16:26.421583 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.421589 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.421854 (+ 265us) server_negotiation.cc:407] Connection header received
0812 11:16:26.422065 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.422071 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.422169 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.422278 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:26.423145 (+ 867us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54768: BlockingRecv error: recv got EOF from 127.0.0.1:54768 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260812 11:16:26.431089 10461 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:26.429065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54780 (local address 127.4.26.125:46279)
0812 11:16:26.429284 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.429290 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.429598 (+ 308us) server_negotiation.cc:407] Connection header received
0812 11:16:26.429760 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.429765 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.429862 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.429977 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:26.430854 (+ 877us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54780: BlockingRecv error: recv got EOF from 127.0.0.1:54780 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260812 11:16:26.440618 10461 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:26.438496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54786 (local address 127.4.26.125:46279)
0812 11:16:26.438731 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.438738 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.439158 (+ 420us) server_negotiation.cc:407] Connection header received
0812 11:16:26.439357 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.439362 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.439474 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.439568 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:26.440364 (+ 796us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54786: BlockingRecv error: recv got EOF from 127.0.0.1:54786 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
W20260812 11:16:26.454564 10461 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:26.452374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54798 (local address 127.4.26.125:46279)
0812 11:16:26.452615 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.452619 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.453091 (+ 472us) server_negotiation.cc:407] Connection header received
0812 11:16:26.453333 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.453338 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.453417 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.453507 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:26.454321 (+ 814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54798: BlockingRecv error: recv got EOF from 127.0.0.1:54798 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260812 11:16:26.476644 10461 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:26.474509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54808 (local address 127.4.26.125:46279)
0812 11:16:26.474728 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.474735 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.475038 (+ 303us) server_negotiation.cc:407] Connection header received
0812 11:16:26.475202 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.475208 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.475311 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.475445 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:26.476360 (+ 915us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54808: BlockingRecv error: recv got EOF from 127.0.0.1:54808 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260812 11:16:26.514395 10461 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:26.512321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54812 (local address 127.4.26.125:46279)
0812 11:16:26.512556 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.512563 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.512915 (+ 352us) server_negotiation.cc:407] Connection header received
0812 11:16:26.513114 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.513119 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.513259 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.513382 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:26.514158 (+ 776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54812: BlockingRecv error: recv got EOF from 127.0.0.1:54812 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260812 11:16:26.584092 10461 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:26.582069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54828 (local address 127.4.26.125:46279)
0812 11:16:26.582265 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.582271 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.582610 (+ 339us) server_negotiation.cc:407] Connection header received
0812 11:16:26.582779 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.582786 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.582894 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.583022 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:26.583868 (+ 846us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54828: BlockingRecv error: recv got EOF from 127.0.0.1:54828 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260812 11:16:26.717619 10461 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 11:16:26.715740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54840 (local address 127.4.26.125:46279)
0812 11:16:26.715912 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.715917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.716274 (+ 357us) server_negotiation.cc:407] Connection header received
0812 11:16:26.716428 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.716433 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.716511 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.716612 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0812 11:16:26.717376 (+ 764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54840: BlockingRecv error: recv got EOF from 127.0.0.1:54840 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260812 11:16:26.771755 10632 catalog_manager.cc:1259] Loaded cluster ID: 04f207cc5d964adc8d7bbf2d03f757e9
I20260812 11:16:26.771909 10632 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24: loading cluster ID for follower catalog manager: success
I20260812 11:16:26.774585 10632 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24: acquiring CA information for follower catalog manager: success
I20260812 11:16:26.776501 10632 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7f505b440c544b4ea89bda1577018d24: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:16:26.840473 10658 catalog_manager.cc:1259] Loaded cluster ID: 04f207cc5d964adc8d7bbf2d03f757e9
I20260812 11:16:26.840596 10658 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a: loading cluster ID for follower catalog manager: success
I20260812 11:16:26.843303 10658 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a: acquiring CA information for follower catalog manager: success
I20260812 11:16:26.845366 10658 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 06ed95a7835f472abffc67ab3a4bc76a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 11:16:26.984195 10461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:26.978557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54842 (local address 127.4.26.125:46279)
0812 11:16:26.978780 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.978786 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.978906 (+ 120us) server_negotiation.cc:407] Connection header received
0812 11:16:26.979147 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.979151 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.979324 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.979432 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:26.979894 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:26.980610 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:26.982010 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:26.982414 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:26.982533 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:26.983056 (+ 523us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:26.983606 (+ 550us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:26.983743 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:26.983849 (+ 106us) server_negotiation.cc:299] Negotiation successful
0812 11:16:26.983935 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260812 11:16:26.996379 10820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:26.990278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35414 (local address 127.4.26.124:45731)
0812 11:16:26.990788 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:26.990793 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:26.990813 (+ 20us) server_negotiation.cc:407] Connection header received
0812 11:16:26.991108 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:26.991113 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:26.991296 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:26.991471 (+ 175us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:26.991849 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:26.992585 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:26.994015 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:26.994440 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:26.994561 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:26.995180 (+ 619us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:26.995749 (+ 569us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:26.995867 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:26.995977 (+ 110us) server_negotiation.cc:299] Negotiation successful
0812 11:16:26.996061 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":281,"threads_started":1}
I20260812 11:16:27.010210 10461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:27.002859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54844 (local address 127.4.26.125:46279)
0812 11:16:27.003110 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:27.003118 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:27.003970 (+ 852us) server_negotiation.cc:407] Connection header received
0812 11:16:27.004183 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:27.004190 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:27.004289 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:27.004384 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:27.005420 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:27.006486 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:27.007937 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:27.008558 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:27.008702 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:27.009420 (+ 718us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:27.009588 (+ 168us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:27.009639 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:27.009835 (+ 196us) server_negotiation.cc:299] Negotiation successful
0812 11:16:27.009923 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260812 11:16:27.011624 10820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:27.004594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35416 (local address 127.4.26.124:45731)
0812 11:16:27.004766 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:27.004770 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:27.005479 (+ 709us) server_negotiation.cc:407] Connection header received
0812 11:16:27.005655 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:27.005660 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:27.005747 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:27.005841 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:27.006509 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:27.007688 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:27.009546 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:27.010169 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:27.010279 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:27.010870 (+ 591us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:27.010988 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:27.011080 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:27.011219 (+ 139us) server_negotiation.cc:299] Negotiation successful
0812 11:16:27.011342 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260812 11:16:27.012696 10831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0812 11:16:27.002859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56294 (local address 127.4.26.126:37783)
0812 11:16:27.003462 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0812 11:16:27.003467 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0812 11:16:27.004975 (+ 1508us) server_negotiation.cc:407] Connection header received
0812 11:16:27.005424 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0812 11:16:27.005431 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0812 11:16:27.005685 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0812 11:16:27.005856 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0812 11:16:27.006745 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:27.007871 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:27.010047 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0812 11:16:27.010686 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0812 11:16:27.010787 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0812 11:16:27.011565 (+ 778us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0812 11:16:27.012032 (+ 467us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0812 11:16:27.012098 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0812 11:16:27.012314 (+ 216us) server_negotiation.cc:299] Negotiation successful
0812 11:16:27.012405 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":381,"threads_started":1}
I20260812 11:16:27.017271 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 10236
I20260812 11:16:27.018456 10324 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:27.157815 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 10236
I20260812 11:16:27.190266 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 10345
I20260812 11:16:27.191532 10450 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:27.302285 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 10345
I20260812 11:16:27.331844 4201 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskpQKIib/build/asan/bin/kudu pid 10466
I20260812 11:16:27.333089 10589 generic_service.cc:196] Checking for leaks (request via RPC)
I20260812 11:16:27.441697 4201 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskpQKIib/build/asan/bin/kudu with pid 10466
2026-08-12T11:16:27Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5072 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10264 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (389774 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST